2024-05-12T22:36:44.380 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-12T22:36:44.380 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} --name teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995 -- /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/orig.config.yaml 2024-05-12T22:36:44.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T22:36:44.523 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995 branch: squid description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} email: ceph-qa@ceph.com first_in_suite: false job_id: '7703995' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: client acl type: posix_acl client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: f72fecff68e1d400c4568684327c900485c20d6a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f72fecff68e1d400c4568684327c900485c20d6a thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: c50db29d375ad9ca1a200449f9347b89e25fb278 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 521 sha1: f72fecff68e1d400c4568684327c900485c20d6a sleep_before_teardown: 0 subset: 295/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_c50db29d375ad9ca1a200449f9347b89e25fb278/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: c50db29d375ad9ca1a200449f9347b89e25fb278 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBBEnzyUeCs9Q6lXGc4M3B0UgYIC82mjWw72QaXP7ezJDBQWXF7tRVmhrU5qUDuYOVqQeLVrgYfjC/vTbZXNSYM= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEJ/lRmCpF4JZ7sp2mhJYS71d39VNBPGbmqDdhz6QJvWaP+eZ2gjZ/PLkw5o1RlNvw99PloHQepVQmpNSucLR4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - fs/misc/acl.sh - fs/misc/chmod.sh - fs/misc/dac_override.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-12_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-12T22:36:44.524 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_c50db29d375ad9ca1a200449f9347b89e25fb278/qa; will attempt to use it 2024-05-12T22:36:44.525 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_c50db29d375ad9ca1a200449f9347b89e25fb278/qa/tasks 2024-05-12T22:36:44.525 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-12T22:36:44.527 INFO:teuthology.task.internal:Checking packages... 2024-05-12T22:36:44.559 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f72fecff68e1d400c4568684327c900485c20d6a' 2024-05-12T22:36:44.559 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-12T22:36:44.559 INFO:teuthology.packaging:ref: None 2024-05-12T22:36:44.559 INFO:teuthology.packaging:tag: None 2024-05-12T22:36:44.559 INFO:teuthology.packaging:branch: squid 2024-05-12T22:36:44.560 INFO:teuthology.packaging:sha1: f72fecff68e1d400c4568684327c900485c20d6a 2024-05-12T22:36:44.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-05-12T22:36:44.854 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2561-gc9f29912-1jammy 2024-05-12T22:36:44.856 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-12T22:36:44.863 INFO:teuthology.task.internal:no buildpackages task found 2024-05-12T22:36:44.863 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-12T22:36:44.869 INFO:teuthology.task.internal:Saving configuration 2024-05-12T22:36:44.889 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-12T22:36:44.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-12T22:36:44.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 22:31:21.136352', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICahhJW/iIMOd1lPRe9TyyIgdd+H1nM5sWxPX/TPDxwy'} 2024-05-12T22:36:44.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-12 22:31:21.137817', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHCyi3gKhECuEV4jt87CAD1iHym0lbK+Ez32YobqMAL7'} 2024-05-12T22:36:44.948 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-12T22:36:44.954 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-12T22:36:44.954 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-12T22:36:44.954 INFO:teuthology.run_tasks:Running task console_log... 2024-05-12T22:36:45.033 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f03059a23a0>, signals=[15]) 2024-05-12T22:36:45.033 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-12T22:36:45.040 INFO:teuthology.task.internal:Opening connections... 2024-05-12T22:36:45.040 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:36:45.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:36:45.124 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:36:45.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:36:45.214 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-12T22:36:45.222 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-05-12T22:36:45.228 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-05-12T22:36:45.228 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-05-12T22:36:45.275 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2024-05-12T22:36:45.276 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2024-05-12T22:36:45.277 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-12T22:36:45.277 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-12T22:36:45.277 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-12T22:36:45.277 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-12T22:36:45.277 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2024-05-12T22:36:45.279 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-05-12T22:36:45.304 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-12T22:36:45.309 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-12T22:36:45.310 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-12T22:36:45.355 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-12T22:36:45.355 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-05-12T22:36:45.355 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-05-12T22:36:45.355 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-12T22:36:45.356 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-05-12T22:36:45.356 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-12T22:36:45.380 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-12T22:36:45.392 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-12T22:36:45.411 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-12T22:36:45.412 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-05-12T22:36:45.414 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-12T22:36:45.419 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-12T22:36:45.425 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-12T22:36:45.425 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-05-12T22:36:45.460 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-12T22:36:45.469 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-12T22:36:45.533 INFO:teuthology.run_tasks:Running task kernel... 2024-05-12T22:36:45.547 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-12T22:36:45.547 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-12T22:36:45.547 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T22:36:45.548 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-12T22:36:45.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:36:45.553 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-05-12T22:36:45.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:36:45.554 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-12T22:36:45.598 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-56-generic 2024-05-12T22:36:45.599 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.15.0-56-generic 2024-05-12T22:36:45.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-05-12T22:36:45.600 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-56-generic 2024-05-12T22:36:45.600 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.15.0-56-generic 2024-05-12T22:36:45.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-05-12T22:36:45.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-05-12T22:36:45.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-05-12T22:36:45.887 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:36:45.887 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-12T22:36:45.887 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-12T22:36:45.915 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-12T22:36:45.981 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-12T22:36:45.985 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:36:46.068 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-12T22:36:46.115 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-12T22:36:46.127 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-12T22:36:46.194 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-12T22:36:46.215 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-12T22:36:46.264 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-12T22:36:46.266 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-12T22:36:46.267 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-12T22:36:46.267 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-12T22:36:46.269 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-12T22:36:46.286 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-12T22:36:46.299 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-12T22:36:46.305 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-12T22:36:46.306 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-12T22:36:46.315 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-12T22:36:46.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-12T22:36:46.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-12T22:36:46.332 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-12T22:36:46.361 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-12T22:36:46.361 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-12T22:36:46.363 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-12T22:36:46.364 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-12T22:36:46.365 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-12T22:36:46.371 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-12T22:36:46.372 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-12T22:36:46.372 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-12T22:36:46.372 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-12T22:36:46.372 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-12T22:36:46.381 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-12T22:36:46.381 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-12T22:36:46.397 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-12T22:36:46.416 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-12T22:36:46.424 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-12T22:36:46.425 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-12T22:36:46.425 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-12T22:36:46.426 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-12T22:36:46.429 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-12T22:36:46.430 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-12T22:36:46.431 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-12T22:36:46.435 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-12T22:36:46.435 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-12T22:36:46.440 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-12T22:36:46.440 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-12T22:36:46.456 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-12T22:36:46.465 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-12T22:36:46.468 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-12T22:36:46.468 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-12T22:36:46.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-12T22:36:46.470 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-12T22:36:46.470 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-12T22:36:46.470 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-12T22:36:46.471 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-12T22:36:46.489 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-12T22:36:46.490 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-12T22:36:46.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-12T22:36:46.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-12T22:36:46.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-12T22:36:46.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-12T22:36:46.567 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-12T22:36:46.768 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-12T22:36:46.918 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-12T22:36:46.932 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-12T22:36:46.933 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-12T22:36:46.996 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-12T22:36:46.997 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-12T22:36:47.004 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-12T22:36:47.272 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-12T22:36:47.851 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-12T22:36:47.962 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-12T22:36:47.982 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-12T22:36:47.984 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-12T22:36:47.985 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-12T22:36:47.988 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-12T22:36:47.988 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-12T22:36:47.989 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-12T22:36:47.993 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-12T22:36:47.997 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-12T22:36:48.162 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-12T22:36:48.245 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-12T22:36:48.326 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-12T22:36:48.381 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-12T22:36:48.432 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-12T22:36:52.293 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 13.4 MB in 2s (6,812 kB/s) 2024-05-12T22:36:52.959 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 13.4 MB in 3s (5,067 kB/s) 2024-05-12T22:36:53.620 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:36:53.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-12T22:36:53.704 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:36:53.905 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-05-12T22:36:53.906 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-05-12T22:36:54.089 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:36:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:36:54.089 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:36:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:36:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-12T22:36:54.090 INFO:teuthology.orchestra.run.smithi047.stdout: python2.7-minimal 2024-05-12T22:36:54.090 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:36:54.091 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-05-12T22:36:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-12T22:36:54.091 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-12T22:36:54.092 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-12T22:36:54.093 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-05-12T22:36:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-12T22:36:54.093 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-05-12T22:36:54.093 INFO:teuthology.orchestra.run.smithi047.stdout: thermald 2024-05-12T22:36:54.143 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-05-12T22:36:54.144 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-12T22:36:54.144 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-12T22:36:54.144 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-12T22:36:54.145 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-05-12T22:36:54.146 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-12T22:36:54.326 INFO:teuthology.orchestra.run.smithi047.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-12T22:36:54.327 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 113 MB of archives. 2024-05-12T22:36:54.327 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-12T22:36:54.327 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-12T22:36:54.430 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:36:54.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-12T22:36:54.513 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:36:54.717 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-05-12T22:36:54.717 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-05-12T22:36:54.899 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:36:54.899 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:36:54.899 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:36:54.900 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:36:54.900 INFO:teuthology.orchestra.run.smithi040.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-12T22:36:54.900 INFO:teuthology.orchestra.run.smithi040.stdout: python2.7-minimal 2024-05-12T22:36:54.900 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:36:54.901 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-05-12T22:36:54.901 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-12T22:36:54.901 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-12T22:36:54.901 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-12T22:36:54.903 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-05-12T22:36:54.903 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-12T22:36:54.903 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2024-05-12T22:36:54.903 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2024-05-12T22:36:54.954 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-05-12T22:36:54.954 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-12T22:36:54.955 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-12T22:36:54.955 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-12T22:36:54.956 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2024-05-12T22:36:54.956 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-12T22:36:55.139 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-12T22:36:55.139 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 113 MB of archives. 2024-05-12T22:36:55.139 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-12T22:36:55.139 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-12T22:37:16.933 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-12T22:37:17.379 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-12T22:37:18.514 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-12T22:37:18.535 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-12T22:37:18.556 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-12T22:37:18.741 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-12T22:37:18.797 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-12T22:37:19.241 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 113 MB in 24s (4,756 kB/s) 2024-05-12T22:37:19.425 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-12T22:37:21.036 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-12T22:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-12T22:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:21.490 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:22.075 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-12T22:37:23.633 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-12T22:37:23.655 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:23.738 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:24.195 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-12T22:37:24.216 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:24.253 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:27.138 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-12T22:37:27.221 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-12T22:37:27.303 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-12T22:37:28.019 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-12T22:37:28.311 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-12T22:37:28.719 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 113 MB in 34s (3,318 kB/s) 2024-05-12T22:37:28.900 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-12T22:37:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:30.824 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-12T22:37:30.828 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:30.889 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-12T22:37:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-12T22:37:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-12T22:37:32.990 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-12T22:37:33.011 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:33.099 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:33.509 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-12T22:37:33.530 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:33.568 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:37.593 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-12T22:37:37.631 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:37.668 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:39.906 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:40.029 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:40.337 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:40.362 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:40.450 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:40.488 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:40.769 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-12T22:37:40.792 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-12T22:37:40.836 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-12T22:37:40.847 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-12T22:37:40.951 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:41.052 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-12T22:37:41.172 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:42.488 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:37:42.488 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-12T22:37:42.488 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:37:42.488 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-12T22:37:42.641 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:44.068 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:45.469 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-12T22:37:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-12T22:37:45.713 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:45.768 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-12T22:37:45.768 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:37:46.028 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-12T22:37:46.065 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-12T22:37:46.102 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:49.084 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-12T22:37:49.182 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-12T22:37:49.491 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-12T22:37:49.603 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:49.729 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-12T22:37:49.858 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:51.173 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:37:51.173 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-12T22:37:51.173 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:37:51.173 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-12T22:37:51.318 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:52.761 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:54.178 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-12T22:37:54.304 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-12T22:37:54.432 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-12T22:37:54.497 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-12T22:37:54.497 INFO:teuthology.orchestra.run.smithi047.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:38:00.224 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-12T22:38:00.224 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2024-05-12T22:38:00.239 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T22:38:00.266 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2024-05-12T22:38:00.568 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:38:00.602 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:38:00.968 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:38:00.973 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T22:38:01.042 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T22:38:01.048 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T22:38:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T22:38:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T22:38:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T22:38:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-05-12T22:38:01.754 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-05-12T22:38:01.777 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 21 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.106.106 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-05-12T22:38:01.778 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-05-12T22:38:01.779 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-12T22:38:01.779 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-12T22:38:01.779 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-12T22:38:01.779 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-12T22:38:01.779 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-05-12T22:38:01.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-05-12T22:38:01.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-05-12T22:38:02.225 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:38:02.226 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T22:38:02.254 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T22:38:02.306 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T22:38:03.654 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:38:03.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-12T22:38:03.734 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:38:03.938 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-05-12T22:38:03.939 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-05-12T22:38:04.124 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-12T22:38:04.124 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:38:04.124 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:38:04.124 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:38:04.125 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:38:04.125 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:38:04.125 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:38:04.125 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:38:04.169 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-12T22:38:04.171 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 21 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-05-12T22:38:04.188 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.106.106 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-05-12T22:38:04.189 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-05-12T22:38:04.189 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-05-12T22:38:04.234 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.T1DYUqhQ6n 2024-05-12T22:38:04.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.T1DYUqhQ6n 2024-05-12T22:38:04.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.T1DYUqhQ6n 2024-05-12T22:38:04.412 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.T1DYUqhQ6n is 10KB 2024-05-12T22:38:04.426 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.T1DYUqhQ6n 2024-05-12T22:38:04.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-12T22:38:04.485 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:38:04.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-12T22:38:04.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-12T22:38:04.553 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-12T22:38:04.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2024-05-12T22:38:05.848 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2024-05-12T22:38:05.849 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T22:38:05.856 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-05-12T22:38:06.043 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:38:06.050 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:38:06.336 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:38:06.341 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T22:38:06.385 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T22:38:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T22:38:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T22:38:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T22:38:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T22:38:06.564 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-05-12T22:38:06.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-05-12T22:38:08.749 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-12T22:38:08.749 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub' 2024-05-12T22:38:08.759 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T22:38:08.767 INFO:teuthology.orchestra.run.smithi047.stdout:Generating grub configuration file ... 2024-05-12T22:38:09.035 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:38:09.053 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:38:09.335 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:38:09.341 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T22:38:09.410 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T22:38:09.415 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T22:38:09.690 INFO:teuthology.orchestra.run.smithi047.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T22:38:09.690 INFO:teuthology.orchestra.run.smithi047.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T22:38:09.690 INFO:teuthology.orchestra.run.smithi047.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T22:38:09.736 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-05-12T22:38:10.221 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.106.106 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-12T22:38:10.247 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-12T22:38:10.248 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-05-12T22:38:10.248 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-05-12T22:38:10.248 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-05-12T22:38:10.248 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-05-12T22:38:10.248 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-12T22:38:10.248 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-12T22:38:10.248 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-12T22:38:10.248 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-12T22:38:10.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-05-12T22:38:10.248 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-05-12T22:38:10.444 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-05-12T22:38:10.563 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T22:38:10.678 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:38:10.763 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T22:38:10.842 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T22:38:11.953 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:38:11.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-12T22:38:12.032 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:38:12.244 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-05-12T22:38:12.245 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-05-12T22:38:12.428 INFO:teuthology.orchestra.run.smithi047.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-12T22:38:12.428 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:38:12.428 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:38:12.428 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:38:12.428 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:38:12.429 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:38:12.429 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:38:12.429 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:38:12.471 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-12T22:38:12.473 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-05-12T22:38:12.490 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.106.106 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-05-12T22:38:12.491 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-05-12T22:38:12.492 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-05-12T22:38:12.492 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-12T22:38:12.538 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.JQQvsJA1W0 2024-05-12T22:38:12.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JQQvsJA1W0 2024-05-12T22:38:12.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.JQQvsJA1W0 2024-05-12T22:38:12.708 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.JQQvsJA1W0 is 10KB 2024-05-12T22:38:12.721 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.JQQvsJA1W0 2024-05-12T22:38:12.727 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-12T22:38:12.782 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:38:12.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-12T22:38:12.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-12T22:38:12.851 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-12T22:38:12.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo update-grub 2024-05-12T22:38:13.962 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-05-12T22:38:13.964 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-12T22:38:13.967 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-05-12T22:38:14.156 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-12T22:38:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-12T22:38:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-12T22:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-12T22:38:14.425 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-12T22:38:14.430 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-12T22:38:14.592 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-12T22:38:14.592 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-12T22:38:14.592 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-12T22:38:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-05-12T22:38:14.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-05-12T22:38:36.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-12T22:38:36.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:38:36.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:38:44.622 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-12T22:38:44.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:38:44.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:38:55.007 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-05-12T22:39:04.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:39:04.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:39:07.073 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-05-12T22:39:19.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:39:19.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:39:44.651 DEBUG:teuthology.orchestra.remote:timed out 2024-05-12T22:39:53.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:39:53.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:39:53.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-05-12T22:40:05.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:40:05.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:40:05.899 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-12T22:40:06.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:40:06.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-12T22:40:06.430 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-12T22:40:06.475 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-106-generic 2024-05-12T22:40:06.476 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-12T22:40:06.476 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-12T22:40:06.476 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-12T22:40:07.476 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-12T22:40:07.477 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-12T22:40:07.542 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-05-12T22:40:07.569 DEBUG:teuthology.parallel:result is None 2024-05-12T22:40:19.088 DEBUG:teuthology.orchestra.remote:timed out 2024-05-12T22:40:34.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:40:34.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:40:34.318 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-05-12T22:40:34.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:40:34.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-12T22:40:34.889 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-05-12T22:40:34.935 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-106-generic 2024-05-12T22:40:34.935 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-12T22:40:34.935 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-12T22:40:34.935 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-12T22:40:35.937 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-12T22:40:35.937 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-12T22:40:36.000 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-05-12T22:40:36.033 DEBUG:teuthology.parallel:result is None 2024-05-12T22:40:36.033 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-12T22:40:36.041 INFO:teuthology.task.internal:Creating test directory... 2024-05-12T22:40:36.041 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T22:40:36.043 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-12T22:40:36.050 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-12T22:40:36.056 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-12T22:40:36.064 INFO:teuthology.task.internal:Creating archive directory... 2024-05-12T22:40:36.064 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T22:40:36.092 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-12T22:40:36.114 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-12T22:40:36.121 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-12T22:40:36.121 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T22:40:36.148 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-12T22:40:36.167 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T22:40:36.170 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T22:40:36.175 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T22:40:36.180 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-12T22:40:36.182 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-12T22:40:36.189 INFO:teuthology.task.internal:Configuring sudo... 2024-05-12T22:40:36.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T22:40:36.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-12T22:40:36.235 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-12T22:40:36.244 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-12T22:40:36.244 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T22:40:36.276 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-12T22:40:36.283 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T22:40:36.328 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T22:40:36.377 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:40:36.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T22:40:36.451 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-12T22:40:36.457 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-12T22:40:36.504 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:40:36.504 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-12T22:40:36.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-05-12T22:40:36.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-12T22:40:36.644 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-12T22:40:36.651 INFO:teuthology.task.internal:Starting timer... 2024-05-12T22:40:36.652 INFO:teuthology.run_tasks:Running task pcp... 2024-05-12T22:40:36.661 INFO:teuthology.run_tasks:Running task selinux... 2024-05-12T22:40:36.675 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2024-05-12T22:40:36.675 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2024-05-12T22:40:36.676 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-12T22:40:36.676 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-12T22:40:36.676 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-12T22:40:36.676 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-12T22:40:36.689 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-12T22:40:36.709 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-12T22:40:36.710 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-12T22:47:50.044 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2024-05-12T22:47:50.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:47:50.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:47:50.132 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-05-12T22:47:50.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-05-12T22:47:50.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:47:50.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-12T22:47:50.289 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-12T22:47:50.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-12T22:47:50.371 INFO:teuthology.run_tasks:Running task clock... 2024-05-12T22:47:50.383 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-12T22:47:50.383 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T22:47:50.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T22:47:50.386 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-12T22:47:50.386 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Command line: ntpd -gq 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: ---------------------------------------------------- 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: ntp-4 is maintained by Network Time Foundation, 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: corporation. Support and training for ntp-4 are 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: available at https://www.nwtime.org/support 2024-05-12T22:47:50.415 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: ---------------------------------------------------- 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: proto: precision = 0.046 usec (-24) 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: basedate set to 2022-02-04 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: gps base set to 2022-02-06 (week 2196) 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T22:47:50.416 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-12T22:47:50.417 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: restrict ::: KOD does nothing without LIMITED. 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen and drop on 0 v6wildcard [::]:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen normally on 2 lo 127.0.0.1:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen normally on 3 ens1f0 172.21.15.40:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen normally on 4 lo [::1]:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%3]:123 2024-05-12T22:47:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:50 ntpd[17222]: Listening on routing socket on fd #22 for interface updates 2024-05-12T22:47:50.438 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-12T22:47:50.438 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Command line: ntpd -gq 2024-05-12T22:47:50.438 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: ---------------------------------------------------- 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: ntp-4 is maintained by Network Time Foundation, 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: corporation. Support and training for ntp-4 are 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: available at https://www.nwtime.org/support 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: ---------------------------------------------------- 2024-05-12T22:47:50.439 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: proto: precision = 0.069 usec (-24) 2024-05-12T22:47:50.440 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: basedate set to 2022-02-04 2024-05-12T22:47:50.440 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: gps base set to 2022-02-06 (week 2196) 2024-05-12T22:47:50.440 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T22:47:50.440 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-12T22:47:50.440 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: restrict ::: KOD does nothing without LIMITED. 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen and drop on 0 v6wildcard [::]:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen normally on 2 lo 127.0.0.1:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen normally on 3 ens1f0 172.21.15.47:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen normally on 4 lo [::1]:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%4]:123 2024-05-12T22:47:50.441 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:50 ntpd[17166]: Listening on routing socket on fd #22 for interface updates 2024-05-12T22:47:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:51 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:52 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:53 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:54.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:54.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:54.418 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:54 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:55 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:55 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:56.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:56.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:56.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:56.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:56 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:57 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stdout:12 May 22:47:57 ntpd[17166]: ntpd: time slew -0.001190 s 2024-05-12T22:47:57.440 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time slew -0.001190s 2024-05-12T22:47:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-12T22:47:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:12 May 22:47:57 ntpd[17166]: can't open /var/log/ntpstats/loopstats.20240512: Permission denied 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:57.493 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: can't open /var/log/ntpstats/rawstats.20240512: Permission denied 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: can't open /var/log/ntpstats/peerstats.20240512: Permission denied 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stdout:12 May 22:47:58 ntpd[17222]: ntpd: time slew +0.000837 s 2024-05-12T22:47:58.417 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew +0.000837s 2024-05-12T22:47:58.418 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-12T22:47:58.418 INFO:teuthology.orchestra.run.smithi040.stderr:12 May 22:47:58 ntpd[17222]: can't open /var/log/ntpstats/loopstats.20240512: Permission denied 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:58.469 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-12T22:47:58.470 INFO:teuthology.run_tasks:Running task install... 2024-05-12T22:47:58.480 DEBUG:teuthology.task.install:project ceph 2024-05-12T22:47:58.480 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a'}} 2024-05-12T22:47:58.480 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a'} 2024-05-12T22:47:58.480 INFO:teuthology.task.install:Using flavor: default 2024-05-12T22:47:58.486 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-12T22:47:58.486 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-12T22:47:58.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-key list | grep Ceph 2024-05-12T22:47:58.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2024-05-12T22:47:58.552 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-12T22:47:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-12T22:47:58.581 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-12T22:47:58.581 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2024-05-12T22:47:58.582 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-12T22:47:58.582 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-12T22:47:58.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f72fecff68e1d400c4568684327c900485c20d6a 2024-05-12T22:47:58.598 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-12T22:47:58.598 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph.com (release key) 2024-05-12T22:47:58.599 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-12T22:47:58.599 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-12T22:47:58.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f72fecff68e1d400c4568684327c900485c20d6a 2024-05-12T22:47:58.746 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default/ 2024-05-12T22:47:58.746 INFO:teuthology.task.install.deb:Package version is 19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:47:58.815 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default/ 2024-05-12T22:47:58.815 INFO:teuthology.task.install.deb:Package version is 19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:47:58.859 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:47:58.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-12T22:47:58.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-05-12T22:47:58.926 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:47:58.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-12T22:47:58.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-05-12T22:47:59.048 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T22:47:59.048 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:47:59.068 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T22:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T22:47:59.096 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy InRelease 2024-05-12T22:47:59.115 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-12T22:47:59.117 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-12T22:47:59.127 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-12T22:47:59.139 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-12T22:47:59.147 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-12T22:47:59.160 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-05-12T22:47:59.187 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-05-12T22:47:59.224 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy InRelease 2024-05-12T22:47:59.238 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-12T22:47:59.261 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-12T22:47:59.298 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-12T22:47:59.334 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-05-12T22:47:59.379 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-05-12T22:47:59.412 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 28.2 kB in 0s (78.5 kB/s) 2024-05-12T22:47:59.483 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 28.2 kB in 0s (78.5 kB/s) 2024-05-12T22:48:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:48:00.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2555-gf72fecff-1jammy cephadm=19.0.0-2555-gf72fecff-1jammy ceph-mds=19.0.0-2555-gf72fecff-1jammy ceph-mgr=19.0.0-2555-gf72fecff-1jammy ceph-common=19.0.0-2555-gf72fecff-1jammy ceph-fuse=19.0.0-2555-gf72fecff-1jammy ceph-test=19.0.0-2555-gf72fecff-1jammy ceph-volume=19.0.0-2555-gf72fecff-1jammy radosgw=19.0.0-2555-gf72fecff-1jammy python3-rados=19.0.0-2555-gf72fecff-1jammy python3-rgw=19.0.0-2555-gf72fecff-1jammy python3-cephfs=19.0.0-2555-gf72fecff-1jammy python3-rbd=19.0.0-2555-gf72fecff-1jammy libcephfs2=19.0.0-2555-gf72fecff-1jammy libcephfs-dev=19.0.0-2555-gf72fecff-1jammy librados2=19.0.0-2555-gf72fecff-1jammy librbd1=19.0.0-2555-gf72fecff-1jammy rbd-fuse=19.0.0-2555-gf72fecff-1jammy python3-cephfs=19.0.0-2555-gf72fecff-1jammy cephfs-shell=19.0.0-2555-gf72fecff-1jammy cephfs-top=19.0.0-2555-gf72fecff-1jammy cephfs-mirror=19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:48:00.478 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:48:00.484 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:48:00.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2555-gf72fecff-1jammy cephadm=19.0.0-2555-gf72fecff-1jammy ceph-mds=19.0.0-2555-gf72fecff-1jammy ceph-mgr=19.0.0-2555-gf72fecff-1jammy ceph-common=19.0.0-2555-gf72fecff-1jammy ceph-fuse=19.0.0-2555-gf72fecff-1jammy ceph-test=19.0.0-2555-gf72fecff-1jammy ceph-volume=19.0.0-2555-gf72fecff-1jammy radosgw=19.0.0-2555-gf72fecff-1jammy python3-rados=19.0.0-2555-gf72fecff-1jammy python3-rgw=19.0.0-2555-gf72fecff-1jammy python3-cephfs=19.0.0-2555-gf72fecff-1jammy python3-rbd=19.0.0-2555-gf72fecff-1jammy libcephfs2=19.0.0-2555-gf72fecff-1jammy libcephfs-dev=19.0.0-2555-gf72fecff-1jammy librados2=19.0.0-2555-gf72fecff-1jammy librbd1=19.0.0-2555-gf72fecff-1jammy rbd-fuse=19.0.0-2555-gf72fecff-1jammy python3-cephfs=19.0.0-2555-gf72fecff-1jammy cephfs-shell=19.0.0-2555-gf72fecff-1jammy cephfs-top=19.0.0-2555-gf72fecff-1jammy cephfs-mirror=19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:48:00.561 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:48:00.686 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-05-12T22:48:00.687 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-05-12T22:48:00.769 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-05-12T22:48:00.769 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-05-12T22:48:00.889 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:48:00.889 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:48:00.889 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:48:00.890 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:48:00.890 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:48:00.890 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:48:00.890 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:48:00.891 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-05-12T22:48:00.891 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-12T22:48:00.891 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-12T22:48:00.891 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T22:48:00.892 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-12T22:48:00.893 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-12T22:48:00.894 INFO:teuthology.orchestra.run.smithi040.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-12T22:48:00.895 INFO:teuthology.orchestra.run.smithi040.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-12T22:48:00.895 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2024-05-12T22:48:00.895 INFO:teuthology.orchestra.run.smithi040.stdout: btrfs-tools 2024-05-12T22:48:00.976 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:48:00.976 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:48:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:48:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:48:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:48:00.977 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:48:00.977 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:48:00.978 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-05-12T22:48:00.979 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-12T22:48:00.979 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-12T22:48:00.979 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T22:48:00.979 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-12T22:48:00.980 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-12T22:48:00.981 INFO:teuthology.orchestra.run.smithi047.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-05-12T22:48:00.982 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2024-05-12T22:48:01.009 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-05-12T22:48:01.009 INFO:teuthology.orchestra.run.smithi040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-12T22:48:01.009 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-12T22:48:01.009 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-12T22:48:01.009 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-12T22:48:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-12T22:48:01.012 INFO:teuthology.orchestra.run.smithi040.stdout: socat unzip xmlstarlet zip 2024-05-12T22:48:01.079 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-12T22:48:01.079 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 180 MB of archives. 2024-05-12T22:48:01.079 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 823 MB of additional disk space will be used. 2024-05-12T22:48:01.079 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-12T22:48:01.094 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-05-12T22:48:01.095 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-12T22:48:01.095 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-12T22:48:01.095 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-12T22:48:01.096 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-12T22:48:01.096 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-12T22:48:01.097 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-12T22:48:01.098 INFO:teuthology.orchestra.run.smithi047.stdout: socat unzip xmlstarlet zip 2024-05-12T22:48:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-12T22:48:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-12T22:48:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2555-gf72fecff-1jammy [3,546 kB] 2024-05-12T22:48:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-12T22:48:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-12T22:48:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-12T22:48:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-12T22:48:01.241 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-12T22:48:01.241 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 180 MB of archives. 2024-05-12T22:48:01.241 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 823 MB of additional disk space will be used. 2024-05-12T22:48:01.241 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2555-gf72fecff-1jammy [3,546 kB] 2024-05-12T22:48:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-12T22:48:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-12T22:48:01.272 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-12T22:48:01.276 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-12T22:48:01.277 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-12T22:48:01.285 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-12T22:48:01.285 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-12T22:48:01.288 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-12T22:48:01.290 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-12T22:48:01.291 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-12T22:48:01.292 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-12T22:48:01.301 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-12T22:48:01.303 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-12T22:48:01.305 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-12T22:48:01.305 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-12T22:48:01.322 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-12T22:48:01.323 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-12T22:48:01.324 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-12T22:48:01.324 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-12T22:48:01.324 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-12T22:48:01.325 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-12T22:48:01.343 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-12T22:48:01.343 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-12T22:48:01.346 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-12T22:48:01.346 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-12T22:48:01.363 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-12T22:48:01.364 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-12T22:48:01.365 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-12T22:48:01.366 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-12T22:48:01.366 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-12T22:48:01.367 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-12T22:48:01.368 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-12T22:48:01.372 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2555-gf72fecff-1jammy [3,216 kB] 2024-05-12T22:48:01.383 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-12T22:48:01.384 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-12T22:48:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-12T22:48:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-12T22:48:01.404 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-12T22:48:01.405 INFO:teuthology.orchestra.run.smithi040.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-12T22:48:01.407 INFO:teuthology.orchestra.run.smithi040.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-12T22:48:01.410 INFO:teuthology.orchestra.run.smithi040.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-12T22:48:01.411 INFO:teuthology.orchestra.run.smithi040.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-12T22:48:01.413 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-12T22:48:01.414 INFO:teuthology.orchestra.run.smithi040.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-12T22:48:01.424 INFO:teuthology.orchestra.run.smithi040.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-12T22:48:01.428 INFO:teuthology.orchestra.run.smithi040.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-12T22:48:01.429 INFO:teuthology.orchestra.run.smithi040.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-12T22:48:01.430 INFO:teuthology.orchestra.run.smithi040.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-12T22:48:01.446 INFO:teuthology.orchestra.run.smithi040.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-12T22:48:01.477 INFO:teuthology.orchestra.run.smithi040.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2555-gf72fecff-1jammy [711 kB] 2024-05-12T22:48:01.499 INFO:teuthology.orchestra.run.smithi040.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2555-gf72fecff-1jammy [356 kB] 2024-05-12T22:48:01.514 INFO:teuthology.orchestra.run.smithi040.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2555-gf72fecff-1jammy [32.8 kB] 2024-05-12T22:48:01.515 INFO:teuthology.orchestra.run.smithi040.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2555-gf72fecff-1jammy [180 kB] 2024-05-12T22:48:01.518 INFO:teuthology.orchestra.run.smithi040.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-12T22:48:01.519 INFO:teuthology.orchestra.run.smithi040.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-12T22:48:01.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-12T22:48:01.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-12T22:48:01.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2555-gf72fecff-1jammy [67.1 kB] 2024-05-12T22:48:01.522 INFO:teuthology.orchestra.run.smithi040.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-12T22:48:01.523 INFO:teuthology.orchestra.run.smithi040.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2555-gf72fecff-1jammy [334 kB] 2024-05-12T22:48:01.534 INFO:teuthology.orchestra.run.smithi040.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2555-gf72fecff-1jammy [6,780 kB] 2024-05-12T22:48:01.541 INFO:teuthology.orchestra.run.smithi040.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-12T22:48:01.543 INFO:teuthology.orchestra.run.smithi040.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-12T22:48:01.543 INFO:teuthology.orchestra.run.smithi040.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-12T22:48:01.558 INFO:teuthology.orchestra.run.smithi040.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-12T22:48:01.558 INFO:teuthology.orchestra.run.smithi040.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-12T22:48:01.564 INFO:teuthology.orchestra.run.smithi040.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-12T22:48:01.565 INFO:teuthology.orchestra.run.smithi040.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-12T22:48:01.565 INFO:teuthology.orchestra.run.smithi040.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-12T22:48:01.566 INFO:teuthology.orchestra.run.smithi040.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-12T22:48:01.566 INFO:teuthology.orchestra.run.smithi040.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-12T22:48:01.585 INFO:teuthology.orchestra.run.smithi040.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-12T22:48:01.588 INFO:teuthology.orchestra.run.smithi040.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-12T22:48:01.590 INFO:teuthology.orchestra.run.smithi040.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-12T22:48:01.591 INFO:teuthology.orchestra.run.smithi040.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-12T22:48:01.592 INFO:teuthology.orchestra.run.smithi040.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-12T22:48:01.609 INFO:teuthology.orchestra.run.smithi040.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-12T22:48:01.612 INFO:teuthology.orchestra.run.smithi040.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-12T22:48:01.612 INFO:teuthology.orchestra.run.smithi040.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-12T22:48:01.613 INFO:teuthology.orchestra.run.smithi040.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-12T22:48:01.613 INFO:teuthology.orchestra.run.smithi040.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-12T22:48:01.615 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-12T22:48:01.633 INFO:teuthology.orchestra.run.smithi040.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-12T22:48:01.634 INFO:teuthology.orchestra.run.smithi040.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-12T22:48:01.637 INFO:teuthology.orchestra.run.smithi040.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-12T22:48:01.638 INFO:teuthology.orchestra.run.smithi040.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-12T22:48:01.638 INFO:teuthology.orchestra.run.smithi040.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-12T22:48:01.653 INFO:teuthology.orchestra.run.smithi040.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-12T22:48:01.655 INFO:teuthology.orchestra.run.smithi040.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-12T22:48:01.655 INFO:teuthology.orchestra.run.smithi040.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-12T22:48:01.663 INFO:teuthology.orchestra.run.smithi040.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-12T22:48:01.663 INFO:teuthology.orchestra.run.smithi040.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-12T22:48:01.674 INFO:teuthology.orchestra.run.smithi040.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-12T22:48:01.676 INFO:teuthology.orchestra.run.smithi040.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-12T22:48:01.676 INFO:teuthology.orchestra.run.smithi040.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-12T22:48:01.710 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-12T22:48:01.723 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-12T22:48:01.774 INFO:teuthology.orchestra.run.smithi040.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2555-gf72fecff-1jammy [112 kB] 2024-05-12T22:48:01.775 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-12T22:48:01.777 INFO:teuthology.orchestra.run.smithi040.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2555-gf72fecff-1jammy [466 kB] 2024-05-12T22:48:01.791 INFO:teuthology.orchestra.run.smithi040.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2555-gf72fecff-1jammy [25.6 MB] 2024-05-12T22:48:01.949 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-12T22:48:01.957 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-12T22:48:01.985 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-12T22:48:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-12T22:48:02.158 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-12T22:48:02.730 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-12T22:48:02.745 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-12T22:48:02.760 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-12T22:48:02.769 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-12T22:48:02.769 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-12T22:48:02.786 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-12T22:48:02.799 INFO:teuthology.orchestra.run.smithi040.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2555-gf72fecff-1jammy [5,084 kB] 2024-05-12T22:48:02.824 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-12T22:48:02.837 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-12T22:48:02.841 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-12T22:48:02.841 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-12T22:48:02.876 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2555-gf72fecff-1jammy [3,216 kB] 2024-05-12T22:48:02.881 INFO:teuthology.orchestra.run.smithi040.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2555-gf72fecff-1jammy [244 kB] 2024-05-12T22:48:02.888 INFO:teuthology.orchestra.run.smithi040.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2555-gf72fecff-1jammy [124 kB] 2024-05-12T22:48:02.892 INFO:teuthology.orchestra.run.smithi040.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2555-gf72fecff-1jammy [1,526 kB] 2024-05-12T22:48:02.947 INFO:teuthology.orchestra.run.smithi040.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2555-gf72fecff-1jammy [6,246 kB] 2024-05-12T22:48:03.020 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-12T22:48:03.112 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-12T22:48:03.120 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-12T22:48:03.166 INFO:teuthology.orchestra.run.smithi040.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2555-gf72fecff-1jammy [22.7 MB] 2024-05-12T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-12T22:48:03.221 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-12T22:48:03.238 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-12T22:48:03.255 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-12T22:48:03.536 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-12T22:48:03.581 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-12T22:48:03.630 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-12T22:48:03.647 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-12T22:48:03.861 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-12T22:48:03.944 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-12T22:48:03.959 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-12T22:48:04.072 INFO:teuthology.orchestra.run.smithi040.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2555-gf72fecff-1jammy [14.1 kB] 2024-05-12T22:48:04.073 INFO:teuthology.orchestra.run.smithi040.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2555-gf72fecff-1jammy [869 kB] 2024-05-12T22:48:04.091 INFO:teuthology.orchestra.run.smithi040.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2555-gf72fecff-1jammy [2,437 kB] 2024-05-12T22:48:04.135 INFO:teuthology.orchestra.run.smithi040.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2555-gf72fecff-1jammy [791 kB] 2024-05-12T22:48:04.137 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-12T22:48:04.145 INFO:teuthology.orchestra.run.smithi040.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2555-gf72fecff-1jammy [148 kB] 2024-05-12T22:48:04.147 INFO:teuthology.orchestra.run.smithi040.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2555-gf72fecff-1jammy [2,331 kB] 2024-05-12T22:48:04.183 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-12T22:48:04.196 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-12T22:48:04.207 INFO:teuthology.orchestra.run.smithi040.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2555-gf72fecff-1jammy [8,625 kB] 2024-05-12T22:48:04.230 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2555-gf72fecff-1jammy [711 kB] 2024-05-12T22:48:04.358 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-12T22:48:04.360 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-12T22:48:04.364 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-12T22:48:04.369 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-12T22:48:04.383 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-12T22:48:04.513 INFO:teuthology.orchestra.run.smithi040.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2555-gf72fecff-1jammy [14.2 kB] 2024-05-12T22:48:04.514 INFO:teuthology.orchestra.run.smithi040.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2555-gf72fecff-1jammy [50.7 MB] 2024-05-12T22:48:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2555-gf72fecff-1jammy [356 kB] 2024-05-12T22:48:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-12T22:48:04.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2555-gf72fecff-1jammy [32.8 kB] 2024-05-12T22:48:04.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2555-gf72fecff-1jammy [180 kB] 2024-05-12T22:48:04.801 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2555-gf72fecff-1jammy [67.1 kB] 2024-05-12T22:48:04.811 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2555-gf72fecff-1jammy [334 kB] 2024-05-12T22:48:04.863 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-12T22:48:04.958 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2555-gf72fecff-1jammy [6,780 kB] 2024-05-12T22:48:04.986 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-12T22:48:05.039 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-12T22:48:05.234 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-12T22:48:05.254 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-12T22:48:05.265 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-12T22:48:05.437 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-12T22:48:06.568 INFO:teuthology.orchestra.run.smithi040.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2555-gf72fecff-1jammy [121 kB] 2024-05-12T22:48:06.570 INFO:teuthology.orchestra.run.smithi040.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2555-gf72fecff-1jammy [229 kB] 2024-05-12T22:48:06.575 INFO:teuthology.orchestra.run.smithi040.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2555-gf72fecff-1jammy [34.0 kB] 2024-05-12T22:48:06.576 INFO:teuthology.orchestra.run.smithi040.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2555-gf72fecff-1jammy [23.4 kB] 2024-05-12T22:48:06.577 INFO:teuthology.orchestra.run.smithi040.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2555-gf72fecff-1jammy [38.9 kB] 2024-05-12T22:48:06.578 INFO:teuthology.orchestra.run.smithi040.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2555-gf72fecff-1jammy [13.4 MB] 2024-05-12T22:48:06.937 INFO:teuthology.orchestra.run.smithi040.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2555-gf72fecff-1jammy [91.6 kB] 2024-05-12T22:48:07.164 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2555-gf72fecff-1jammy [112 kB] 2024-05-12T22:48:07.169 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2555-gf72fecff-1jammy [466 kB] 2024-05-12T22:48:07.248 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2555-gf72fecff-1jammy [25.6 MB] 2024-05-12T22:48:07.582 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 180 MB in 6s (30.4 MB/s) 2024-05-12T22:48:07.713 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-12T22:48:07.802 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-12T22:48:07.808 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-12T22:48:07.854 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-12T22:48:08.148 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-12T22:48:08.175 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-12T22:48:08.226 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T22:48:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cmd2. 2024-05-12T22:48:08.542 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-12T22:48:08.576 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-12T22:48:08.896 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-12T22:48:08.923 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-12T22:48:08.996 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T22:48:09.333 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-12T22:48:09.360 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-12T22:48:09.408 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T22:48:09.736 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-12T22:48:09.763 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-12T22:48:09.803 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T22:48:10.198 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-12T22:48:10.225 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:10.264 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:10.668 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-12T22:48:10.695 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:10.734 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:11.021 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-12T22:48:11.048 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:11.087 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:11.368 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-12T22:48:11.430 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-12T22:48:11.432 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-12T22:48:11.459 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-12T22:48:11.499 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T22:48:11.533 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 2024-05-12T22:48:11.701 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-12T22:48:11.789 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-12T22:48:11.818 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librados2. 2024-05-12T22:48:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../010-librados2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:11.885 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librados2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:11.983 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-12T22:48:12.271 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librbd1. 2024-05-12T22:48:12.287 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../011-librbd1_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:12.321 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librbd1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:12.377 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-12T22:48:12.387 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-12T22:48:12.388 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-12T22:48:12.465 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-12T22:48:12.466 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-12T22:48:12.468 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-12T22:48:12.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-12T22:48:12.470 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-12T22:48:12.636 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-12T22:48:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs2. 2024-05-12T22:48:12.809 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:12.815 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-12T22:48:12.849 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:12.900 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-12T22:48:13.118 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rados. 2024-05-12T22:48:13.134 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-12T22:48:13.176 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rados (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:13.194 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-12T22:48:13.220 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-12T22:48:13.228 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-12T22:48:13.272 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-12T22:48:13.297 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-12T22:48:13.299 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-12T22:48:13.306 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-12T22:48:13.472 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-12T22:48:13.696 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-12T22:48:13.723 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:13.762 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-argparse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:13.982 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cephfs. 2024-05-12T22:48:14.005 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-12T22:48:14.009 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:14.011 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-12T22:48:14.040 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cephfs (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:14.052 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-12T22:48:14.053 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-12T22:48:14.060 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-12T22:48:14.062 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-12T22:48:14.101 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-12T22:48:14.110 INFO:teuthology.orchestra.run.smithi047.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-12T22:48:14.183 INFO:teuthology.orchestra.run.smithi047.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-12T22:48:14.184 INFO:teuthology.orchestra.run.smithi047.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-12T22:48:14.348 INFO:teuthology.orchestra.run.smithi047.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-12T22:48:14.360 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-12T22:48:14.387 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:14.426 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:14.754 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-prettytable. 2024-05-12T22:48:14.781 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-12T22:48:14.786 INFO:teuthology.orchestra.run.smithi047.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-12T22:48:14.801 INFO:teuthology.orchestra.run.smithi047.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-12T22:48:14.821 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-12T22:48:15.067 INFO:teuthology.orchestra.run.smithi047.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2555-gf72fecff-1jammy [5,084 kB] 2024-05-12T22:48:15.074 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rbd. 2024-05-12T22:48:15.087 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-12T22:48:15.101 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:15.140 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rbd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:15.443 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-12T22:48:15.467 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-12T22:48:15.501 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T22:48:15.678 INFO:teuthology.orchestra.run.smithi047.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2555-gf72fecff-1jammy [244 kB] 2024-05-12T22:48:15.700 INFO:teuthology.orchestra.run.smithi047.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2555-gf72fecff-1jammy [124 kB] 2024-05-12T22:48:15.719 INFO:teuthology.orchestra.run.smithi047.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2555-gf72fecff-1jammy [1,526 kB] 2024-05-12T22:48:15.788 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-12T22:48:15.815 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-12T22:48:15.854 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T22:48:15.886 INFO:teuthology.orchestra.run.smithi047.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2555-gf72fecff-1jammy [6,246 kB] 2024-05-12T22:48:16.149 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-12T22:48:16.165 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-12T22:48:16.207 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T22:48:16.527 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package lua5.1. 2024-05-12T22:48:16.554 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-12T22:48:16.560 INFO:teuthology.orchestra.run.smithi047.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2555-gf72fecff-1jammy [22.7 MB] 2024-05-12T22:48:16.593 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-12T22:48:16.897 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package lua-any. 2024-05-12T22:48:16.913 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-12T22:48:16.955 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-12T22:48:17.191 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package zip. 2024-05-12T22:48:17.218 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-12T22:48:17.257 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking zip (3.0-12build2) ... 2024-05-12T22:48:17.569 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package unzip. 2024-05-12T22:48:17.596 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-12T22:48:17.627 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-12T22:48:18.023 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package luarocks. 2024-05-12T22:48:18.049 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-12T22:48:18.089 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-12T22:48:18.472 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librgw2. 2024-05-12T22:48:18.499 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../027-librgw2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:18.539 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librgw2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:18.608 INFO:teuthology.orchestra.run.smithi047.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2555-gf72fecff-1jammy [14.1 kB] 2024-05-12T22:48:18.609 INFO:teuthology.orchestra.run.smithi047.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2555-gf72fecff-1jammy [869 kB] 2024-05-12T22:48:18.650 INFO:teuthology.orchestra.run.smithi047.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2555-gf72fecff-1jammy [2,437 kB] 2024-05-12T22:48:18.819 INFO:teuthology.orchestra.run.smithi047.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2555-gf72fecff-1jammy [791 kB] 2024-05-12T22:48:18.879 INFO:teuthology.orchestra.run.smithi047.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2555-gf72fecff-1jammy [148 kB] 2024-05-12T22:48:18.896 INFO:teuthology.orchestra.run.smithi047.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2555-gf72fecff-1jammy [2,331 kB] 2024-05-12T22:48:19.063 INFO:teuthology.orchestra.run.smithi047.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2555-gf72fecff-1jammy [8,625 kB] 2024-05-12T22:48:19.442 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rgw. 2024-05-12T22:48:19.458 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:19.491 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:19.652 INFO:teuthology.orchestra.run.smithi047.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2555-gf72fecff-1jammy [14.2 kB] 2024-05-12T22:48:19.657 INFO:teuthology.orchestra.run.smithi047.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2555-gf72fecff-1jammy [50.7 MB] 2024-05-12T22:48:19.811 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-12T22:48:19.839 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-12T22:48:19.878 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T22:48:20.181 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libradosstriper1. 2024-05-12T22:48:20.208 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:20.265 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libradosstriper1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:20.684 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-common. 2024-05-12T22:48:20.711 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:20.750 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:22.097 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-base. 2024-05-12T22:48:22.124 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:22.174 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-base (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:22.752 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-12T22:48:22.779 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-12T22:48:22.811 INFO:teuthology.orchestra.run.smithi047.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2555-gf72fecff-1jammy [121 kB] 2024-05-12T22:48:22.814 INFO:teuthology.orchestra.run.smithi047.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2555-gf72fecff-1jammy [229 kB] 2024-05-12T22:48:22.818 INFO:teuthology.orchestra.run.smithi047.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2555-gf72fecff-1jammy [34.0 kB] 2024-05-12T22:48:22.819 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-12T22:48:22.819 INFO:teuthology.orchestra.run.smithi047.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2555-gf72fecff-1jammy [23.4 kB] 2024-05-12T22:48:22.820 INFO:teuthology.orchestra.run.smithi047.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2555-gf72fecff-1jammy [38.9 kB] 2024-05-12T22:48:22.821 INFO:teuthology.orchestra.run.smithi047.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2555-gf72fecff-1jammy [13.4 MB] 2024-05-12T22:48:23.105 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cheroot. 2024-05-12T22:48:23.131 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-12T22:48:23.171 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T22:48:23.446 INFO:teuthology.orchestra.run.smithi047.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/f72fecff68e1d400c4568684327c900485c20d6a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2555-gf72fecff-1jammy [91.6 kB] 2024-05-12T22:48:23.499 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-12T22:48:23.526 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-12T22:48:23.566 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-12T22:48:24.009 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-12T22:48:24.036 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-12T22:48:24.091 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 180 MB in 22s (8,054 kB/s) 2024-05-12T22:48:24.152 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-12T22:48:24.193 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-12T22:48:24.248 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-12T22:48:24.252 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-12T22:48:24.455 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-12T22:48:24.482 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-12T22:48:24.521 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-12T22:48:24.603 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-12T22:48:24.630 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-12T22:48:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempora. 2024-05-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-12T22:48:24.989 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cmd2. 2024-05-12T22:48:25.016 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-12T22:48:25.055 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-12T22:48:25.161 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-portend. 2024-05-12T22:48:25.177 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-12T22:48:25.211 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-12T22:48:25.409 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-12T22:48:25.435 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-12T22:48:25.497 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-12T22:48:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T22:48:25.523 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-12T22:48:25.563 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-12T22:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T22:48:25.893 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-12T22:48:25.933 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-12T22:48:26.209 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-12T22:48:26.233 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-natsort. 2024-05-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-12T22:48:26.673 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-logutils. 2024-05-12T22:48:26.700 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-12T22:48:26.710 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-12T22:48:26.737 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:26.739 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-12T22:48:26.785 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:27.042 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-12T22:48:27.069 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-12T22:48:27.109 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-12T22:48:27.138 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-12T22:48:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:27.188 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-mako. 2024-05-12T22:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-12T22:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T22:48:27.507 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-12T22:48:27.534 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-12T22:48:27.574 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-12T22:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-12T22:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-12T22:48:27.927 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-12T22:48:27.954 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-12T22:48:27.993 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T22:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-12T22:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-12T22:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-12T22:48:28.288 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2. 2024-05-12T22:48:28.304 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../010-librados2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:28.338 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webob. 2024-05-12T22:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-12T22:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-12T22:48:28.782 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1. 2024-05-12T22:48:28.809 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../011-librbd1_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:28.848 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-waitress. 2024-05-12T22:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-12T22:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T22:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempita. 2024-05-12T22:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-12T22:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T22:48:29.443 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2024-05-12T22:48:29.470 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:29.510 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-paste. 2024-05-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T22:48:29.787 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2024-05-12T22:48:29.814 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:29.854 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-12T22:48:29.974 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-12T22:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:30.240 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-12T22:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-12T22:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-12T22:48:30.484 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2024-05-12T22:48:30.500 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:30.542 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webtest. 2024-05-12T22:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-12T22:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-12T22:48:30.836 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-12T22:48:30.864 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:30.903 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pecan. 2024-05-12T22:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-12T22:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T22:48:31.197 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2024-05-12T22:48:31.221 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-12T22:48:31.255 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-12T22:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-certifi. 2024-05-12T22:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-12T22:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-12T22:48:31.517 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2024-05-12T22:48:31.544 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:31.583 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-idna. 2024-05-12T22:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-12T22:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-12T22:48:31.928 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-12T22:48:31.955 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-12T22:48:31.994 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T22:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-urllib3. 2024-05-12T22:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-12T22:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T22:48:32.271 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-12T22:48:32.288 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-12T22:48:32.330 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T22:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests. 2024-05-12T22:48:32.599 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-12T22:48:32.615 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-12T22:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-12T22:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T22:48:32.657 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T22:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-12T22:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-12T22:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T22:48:32.993 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua5.1. 2024-05-12T22:48:33.020 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-12T22:48:33.062 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-12T22:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-12T22:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:33.353 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-12T22:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:34.039 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-any. 2024-05-12T22:48:34.066 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-12T22:48:34.102 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-12T22:48:34.105 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-12T22:48:34.129 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-12T22:48:34.467 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package zip. 2024-05-12T22:48:34.494 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-12T22:48:34.525 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking zip (3.0-12build2) ... 2024-05-12T22:48:34.795 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package unzip. 2024-05-12T22:48:34.822 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-12T22:48:34.861 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-12T22:48:35.199 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-openssl. 2024-05-12T22:48:35.227 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-12T22:48:35.248 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package luarocks. 2024-05-12T22:48:35.257 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-12T22:48:35.275 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-12T22:48:35.314 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr. 2024-05-12T22:48:35.604 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:35.668 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:35.682 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2024-05-12T22:48:35.709 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../027-librgw2_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:35.748 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:36.071 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mon. 2024-05-12T22:48:36.099 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:36.138 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mon (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:36.284 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2024-05-12T22:48:36.300 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:36.342 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:36.654 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-12T22:48:36.681 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-12T22:48:36.737 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T22:48:36.916 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-osd. 2024-05-12T22:48:36.944 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:36.982 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-osd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:37.015 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2024-05-12T22:48:37.042 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:37.081 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2024-05-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:37.592 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:38.061 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph. 2024-05-12T22:48:38.088 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../068-ceph_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:38.127 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-fuse. 2024-05-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:38.513 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mds. 2024-05-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mds (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2024-05-12T22:48:38.985 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:39.033 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:39.310 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephadm. 2024-05-12T22:48:39.327 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../071-cephadm_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:39.360 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:39.719 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-12T22:48:39.746 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-12T22:48:39.785 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-12T22:48:39.855 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-12T22:48:39.883 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-12T22:48:39.921 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-12T22:48:40.088 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cheroot. 2024-05-12T22:48:40.115 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-12T22:48:40.154 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T22:48:40.249 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-12T22:48:40.277 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T22:48:40.316 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T22:48:40.474 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-12T22:48:40.501 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-12T22:48:40.541 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-12T22:48:40.802 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-12T22:48:40.829 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-12T22:48:40.877 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-12T22:48:41.146 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-12T22:48:41.173 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-12T22:48:41.213 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-12T22:48:41.270 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-babel. 2024-05-12T22:48:41.287 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T22:48:41.329 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T22:48:41.515 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempora. 2024-05-12T22:48:41.542 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-12T22:48:41.582 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jinja2. 2024-05-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-12T22:48:41.690 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T22:48:41.893 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-portend. 2024-05-12T22:48:41.920 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-12T22:48:41.959 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-12T22:48:42.010 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-12T22:48:42.037 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:42.229 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-12T22:48:42.256 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-12T22:48:42.295 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-12T22:48:42.380 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-12T22:48:42.407 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-12T22:48:42.446 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-12T22:48:42.598 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-12T22:48:42.749 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-routes. 2024-05-12T22:48:42.776 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-12T22:48:42.815 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T22:48:42.960 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-natsort. 2024-05-12T22:48:42.987 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-12T22:48:43.018 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-12T22:48:43.135 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:43.321 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2024-05-12T22:48:43.348 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-12T22:48:43.388 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-12T22:48:43.757 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-12T22:48:44.060 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2024-05-12T22:48:44.087 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-12T22:48:44.126 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T22:48:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-12T22:48:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-12T22:48:44.438 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-12T22:48:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T22:48:44.465 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-12T22:48:44.496 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-12T22:48:44.774 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-12T22:48:44.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-12T22:48:44.840 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-12T22:48:44.910 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-joblib. 2024-05-12T22:48:44.937 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-12T22:48:44.968 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T22:48:45.127 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2024-05-12T22:48:45.153 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-12T22:48:45.193 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-12T22:48:45.322 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-12T22:48:45.349 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-12T22:48:45.473 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-12T22:48:45.546 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2024-05-12T22:48:45.573 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-12T22:48:45.616 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T22:48:45.776 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn. 2024-05-12T22:48:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-12T22:48:45.843 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T22:48:45.907 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2024-05-12T22:48:45.935 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-12T22:48:45.973 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T22:48:46.251 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2024-05-12T22:48:46.278 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-12T22:48:46.309 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T22:48:46.552 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-12T22:48:46.580 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:46.618 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:46.629 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-12T22:48:46.646 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-12T22:48:46.688 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-12T22:48:47.057 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-12T22:48:47.360 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2024-05-12T22:48:47.387 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-12T22:48:47.426 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-12T22:48:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cachetools. 2024-05-12T22:48:47.608 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-12T22:48:47.638 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-12T22:48:47.704 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2024-05-12T22:48:47.731 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-12T22:48:47.762 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T22:48:47.908 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-12T22:48:47.935 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-12T22:48:47.974 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-12T22:48:48.125 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-certifi. 2024-05-12T22:48:48.152 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-12T22:48:48.192 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-12T22:48:48.302 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-12T22:48:48.330 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-12T22:48:48.385 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T22:48:48.528 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-idna. 2024-05-12T22:48:48.555 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-12T22:48:48.595 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-12T22:48:48.689 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rsa. 2024-05-12T22:48:48.716 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-12T22:48:48.755 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-12T22:48:48.864 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-urllib3. 2024-05-12T22:48:48.891 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-12T22:48:48.922 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T22:48:49.076 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-google-auth. 2024-05-12T22:48:49.103 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-12T22:48:49.142 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-12T22:48:49.192 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests. 2024-05-12T22:48:49.208 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-12T22:48:49.242 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T22:48:49.470 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-12T22:48:49.498 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-12T22:48:49.537 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-12T22:48:49.537 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T22:48:49.564 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-12T22:48:49.603 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T22:48:49.807 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-websocket. 2024-05-12T22:48:49.835 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-12T22:48:49.873 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-12T22:48:49.915 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-12T22:48:49.942 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:50.047 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-12T22:48:50.476 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T22:48:50.479 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:50.519 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-12T22:48:50.904 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-12T22:48:51.132 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-12T22:48:51.149 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:51.182 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:51.207 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2024-05-12T22:48:51.235 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-12T22:48:51.274 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-12T22:48:51.510 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-12T22:48:51.538 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-12T22:48:51.576 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T22:48:51.610 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2024-05-12T22:48:51.637 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:51.677 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:51.913 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-12T22:48:51.941 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T22:48:51.979 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T22:48:52.022 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2024-05-12T22:48:52.049 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:52.080 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:52.215 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package jq. 2024-05-12T22:48:52.232 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T22:48:52.266 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-12T22:48:52.485 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package socat. 2024-05-12T22:48:52.513 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-12T22:48:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-12T22:48:52.658 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2024-05-12T22:48:52.686 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:52.724 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:52.862 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package xmlstarlet. 2024-05-12T22:48:52.879 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-12T22:48:52.920 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-12T22:48:53.250 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-test. 2024-05-12T22:48:53.267 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:53.308 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-test (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:53.794 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2024-05-12T22:48:53.810 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../068-ceph_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:53.852 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:54.155 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2024-05-12T22:48:54.182 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:54.221 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:54.525 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2024-05-12T22:48:54.552 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:54.591 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2024-05-12T22:48:55.038 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../071-cephadm_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:55.077 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:55.397 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-12T22:48:55.679 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-volume. 2024-05-12T22:48:55.707 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:55.745 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-volume (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:55.782 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-12T22:48:55.798 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T22:48:55.840 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T22:48:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-12T22:48:56.153 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:56.191 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-mirror (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:56.502 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-colorama. 2024-05-12T22:48:56.530 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-12T22:48:56.568 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-shell. 2024-05-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:56.879 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-babel. 2024-05-12T22:48:56.990 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-shell (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:56.991 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-12T22:48:56.991 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T22:48:57.123 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-top. 2024-05-12T22:48:57.150 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:57.190 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-top (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:57.265 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2024-05-12T22:48:57.292 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-12T22:48:57.331 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T22:48:57.426 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-12T22:48:57.443 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:48:57.484 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs-dev (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:57.676 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-12T22:48:57.703 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:57.742 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:57.795 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-12T22:48:57.824 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-12T22:48:57.861 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T22:48:58.062 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-12T22:48:58.078 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-12T22:48:58.112 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-12T22:48:58.174 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-12T22:48:58.192 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-12T22:48:58.224 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-12T22:48:58.348 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2024-05-12T22:48:58.361 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-12T22:48:58.389 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T22:48:58.587 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package nvme-cli. 2024-05-12T22:48:58.615 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-12T22:48:58.669 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T22:48:58.684 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-12T22:48:58.700 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:48:58.734 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pkg-config. 2024-05-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T22:48:59.394 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-12T22:48:59.411 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-12T22:48:59.452 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-12T22:48:59.855 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-12T22:48:59.884 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-12T22:48:59.930 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-12T22:49:00.184 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T22:49:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastescript. 2024-05-12T22:49:00.220 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-12T22:49:00.258 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-12T22:49:00.578 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pluggy. 2024-05-12T22:49:00.606 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-12T22:49:00.644 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-12T22:49:00.734 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2024-05-12T22:49:00.761 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-12T22:49:00.800 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T22:49:00.964 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-psutil. 2024-05-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-12T22:49:01.179 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-12T22:49:01.206 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-12T22:49:01.330 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-12T22:49:01.342 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-py. 2024-05-12T22:49:01.370 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-12T22:49:01.408 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-12T22:49:01.600 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2024-05-12T22:49:01.627 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-12T22:49:01.658 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T22:49:01.728 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pygments. 2024-05-12T22:49:01.757 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-12T22:49:01.794 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T22:49:02.266 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-12T22:49:02.294 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-12T22:49:02.332 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-12T22:49:02.351 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-12T22:49:02.378 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:49:02.416 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:02.610 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-toml. 2024-05-12T22:49:02.638 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-12T22:49:02.668 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-12T22:49:02.954 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pytest. 2024-05-12T22:49:02.983 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-12T22:49:03.020 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T22:49:03.253 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2024-05-12T22:49:03.281 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-12T22:49:03.311 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-12T22:49:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplejson. 2024-05-12T22:49:03.403 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-12T22:49:03.440 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-12T22:49:03.622 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-12T22:49:03.650 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-12T22:49:03.689 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-12T22:49:03.718 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-12T22:49:03.747 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-12T22:49:03.784 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-12T22:49:04.009 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-12T22:49:04.036 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-12T22:49:04.075 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T22:49:04.386 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2024-05-12T22:49:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-12T22:49:04.422 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package radosgw. 2024-05-12T22:49:04.451 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../122-radosgw_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:04.453 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-12T22:49:04.488 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking radosgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:04.748 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2024-05-12T22:49:04.776 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-12T22:49:04.815 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-12T22:49:05.093 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-12T22:49:05.121 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-12T22:49:05.151 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T22:49:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package rbd-fuse. 2024-05-12T22:49:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:05.383 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking rbd-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:05.437 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2024-05-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-12T22:49:05.782 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-12T22:49:05.810 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-12T22:49:05.840 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T22:49:05.905 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-12T22:49:06.205 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T22:49:06.356 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T22:49:06.512 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-12T22:49:06.529 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:49:06.579 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:06.619 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-12T22:49:06.848 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-12T22:49:06.876 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-12T22:49:06.948 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T22:49:06.956 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-12T22:49:07.268 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-12T22:49:07.295 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T22:49:07.334 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T22:49:07.372 INFO:teuthology.orchestra.run.smithi040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-12T22:49:07.441 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:07.595 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2024-05-12T22:49:07.614 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-12T22:49:07.653 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-12T22:49:07.890 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user cephadm....done 2024-05-12T22:49:07.939 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2024-05-12T22:49:07.968 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-12T22:49:08.006 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-12T22:49:08.022 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2024-05-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-12T22:49:08.557 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-12T22:49:08.684 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-12T22:49:08.696 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2024-05-12T22:49:08.724 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:08.762 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:08.943 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-12T22:49:09.211 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-12T22:49:09.630 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T22:49:10.007 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-12T22:49:10.267 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-12T22:49:10.526 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-12T22:49:10.794 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-12T22:49:11.117 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-volume. 2024-05-12T22:49:11.145 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:49:11.179 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-12T22:49:11.183 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-volume (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:11.423 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-12T22:49:11.529 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-12T22:49:11.557 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:11.595 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-mirror (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:11.690 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-12T22:49:11.848 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-colorama. 2024-05-12T22:49:11.876 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-12T22:49:11.914 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-12T22:49:12.082 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-argparse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:12.200 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-shell. 2024-05-12T22:49:12.229 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:49:12.267 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-shell (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:12.367 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T22:49:12.528 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-top. 2024-05-12T22:49:12.545 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2555-gf72fecff-1jammy_all.deb ... 2024-05-12T22:49:12.586 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-12T22:49:12.586 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-top (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-12T22:49:13.141 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-12T22:49:13.169 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-12T22:49:13.189 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-12T22:49:13.199 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T22:49:13.478 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-12T22:49:13.495 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-12T22:49:13.528 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-12T22:49:13.582 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-12T22:49:13.604 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-12T22:49:13.667 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T22:49:13.785 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2024-05-12T22:49:13.927 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-12T22:49:13.965 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T22:49:14.136 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T22:49:14.237 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-12T22:49:14.370 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pkg-config. 2024-05-12T22:49:14.398 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-12T22:49:14.436 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T22:49:14.496 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T22:49:14.675 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-12T22:49:14.703 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-12T22:49:14.733 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-12T22:49:14.764 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-12T22:49:15.074 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up zip (3.0-12build2) ... 2024-05-12T22:49:15.103 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-12T22:49:15.120 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-12T22:49:15.152 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-12T22:49:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T22:49:15.438 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2024-05-12T22:49:15.467 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-12T22:49:15.513 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-12T22:49:15.867 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2024-05-12T22:49:15.885 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T22:49:15.895 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-12T22:49:15.933 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-12T22:49:16.128 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T22:49:16.237 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-12T22:49:16.244 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2024-05-12T22:49:16.273 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-12T22:49:16.310 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-12T22:49:16.338 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T22:49:16.622 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-12T22:49:16.680 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2024-05-12T22:49:16.709 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-12T22:49:16.746 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-12T22:49:17.084 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pygments. 2024-05-12T22:49:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-12T22:49:17.150 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T22:49:17.266 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T22:49:17.596 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-12T22:49:17.624 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-12T22:49:17.651 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T22:49:17.662 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-toml. 2024-05-12T22:49:17.976 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-12T22:49:18.014 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-12T22:49:18.228 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T22:49:18.317 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2024-05-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T22:49:18.563 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-12T22:49:18.729 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplejson. 2024-05-12T22:49:18.757 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-12T22:49:18.795 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-12T22:49:18.823 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:19.048 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-12T22:49:19.076 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-12T22:49:19.114 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-12T22:49:19.250 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-idna (3.3-1) ... 2024-05-12T22:49:19.568 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T22:49:19.852 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2024-05-12T22:49:19.880 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../122-radosgw_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:19.918 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:20.767 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T22:49:20.980 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2024-05-12T22:49:21.002 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:21.008 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2555-gf72fecff-1jammy_amd64.deb ... 2024-05-12T22:49:21.046 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:21.111 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-12T22:49:21.343 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-12T22:49:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-12T22:49:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-12T22:49:21.598 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T22:49:21.710 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-12T22:49:21.899 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-12T22:49:22.159 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-12T22:49:22.295 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-12T22:49:22.401 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-12T22:49:22.715 INFO:teuthology.orchestra.run.smithi047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-12T22:49:22.770 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:22.821 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-12T22:49:23.080 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-12T22:49:23.348 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-12T22:49:23.411 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2024-05-12T22:49:23.559 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-12T22:49:23.607 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-12T22:49:23.852 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-12T22:49:23.891 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-12T22:49:24.095 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-12T22:49:24.167 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T22:49:24.204 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-12T22:49:24.293 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-12T22:49:24.522 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-12T22:49:24.578 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T22:49:24.687 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T22:49:24.774 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-12T22:49:24.900 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-12T22:49:24.972 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-12T22:49:25.226 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-12T22:49:25.281 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-12T22:49:25.566 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T22:49:25.602 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-12T22:49:25.692 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T22:49:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-12T22:49:25.924 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-12T22:49:26.105 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-12T22:49:26.211 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T22:49:26.381 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-12T22:49:26.649 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-12T22:49:26.755 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-12T22:49:26.909 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-12T22:49:27.023 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-12T22:49:27.149 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-12T22:49:27.168 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-12T22:49:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:27.427 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T22:49:27.670 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-12T22:49:27.771 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-12T22:49:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T22:49:27.951 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-12T22:49:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T22:49:28.156 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-12T22:49:28.291 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-12T22:49:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-12T22:49:28.550 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-12T22:49:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-12T22:49:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-12T22:49:28.958 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-12T22:49:28.989 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-12T22:49:29.061 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-12T22:49:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T22:49:29.196 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-12T22:49:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-12T22:49:29.572 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-12T22:49:29.681 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-12T22:49:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-12T22:49:29.983 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T22:49:30.259 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-12T22:49:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librados2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up zip (3.0-12build2) ... 2024-05-12T22:49:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:30.694 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-12T22:49:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:31.199 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libradosstriper1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-12T22:49:31.421 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librbd1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:31.663 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-12T22:49:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-modules-core (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:31.764 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-12T22:49:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:31.899 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-12T22:49:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T22:49:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T22:49:32.216 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-12T22:49:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs-dev (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:32.609 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-12T22:49:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rados (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librgw2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:32.869 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-12T22:49:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-top (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T22:49:33.237 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-12T22:49:33.521 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-12T22:49:33.814 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-12T22:49:34.296 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rbd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.397 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up rbd-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.458 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-12T22:49:34.523 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.584 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.649 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cephfs (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-shell (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-idna (3.3-1) ... 2024-05-12T22:49:35.236 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-12T22:49:35.444 INFO:teuthology.orchestra.run.smithi040.stdout:Adding group ceph....done 2024-05-12T22:49:35.787 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user ceph....done 2024-05-12T22:49:35.914 INFO:teuthology.orchestra.run.smithi040.stdout:Setting system user ceph properties....done 2024-05-12T22:49:35.932 INFO:teuthology.orchestra.run.smithi040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-12T22:49:36.077 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-12T22:49:36.397 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-12T22:49:36.450 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-12T22:49:36.718 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:36.853 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-12T22:49:36.868 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-mirror (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:37.082 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T22:49:37.082 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T22:49:37.146 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-12T22:49:37.246 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-12T22:49:37.347 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-12T22:49:37.562 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-test (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:37.641 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-12T22:49:37.687 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up radosgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:37.900 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-12T22:49:38.154 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T22:49:38.155 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T22:49:38.159 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:38.302 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-12T22:49:38.595 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-12T22:49:38.598 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-base (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:38.838 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-12T22:49:38.965 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-12T22:49:39.105 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-12T22:49:39.348 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-12T22:49:39.425 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mds (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:39.608 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-12T22:49:39.637 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T22:49:39.637 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T22:49:39.883 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-12T22:49:40.009 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-12T22:49:40.085 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T22:49:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-12T22:49:40.696 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-12T22:49:40.778 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-osd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:40.980 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-12T22:49:41.084 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T22:49:41.084 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T22:49:41.239 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-12T22:49:41.571 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:41.651 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-12T22:49:41.800 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-12T22:49:41.801 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:41.889 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-12T22:49:42.127 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-12T22:49:42.208 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mon (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:42.244 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-12T22:49:42.408 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T22:49:42.408 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T22:49:42.654 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-12T22:49:42.850 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:42.914 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-12T22:49:43.010 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:43.039 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-dashboard (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:43.287 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-volume (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:43.307 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-12T22:49:43.433 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T22:49:43.724 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T22:49:43.759 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-12T22:49:43.876 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-12T22:49:44.328 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-12T22:49:44.782 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-12T22:49:44.952 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T22:49:45.075 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-12T22:49:45.343 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-12T22:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T22:49:45.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-12T22:49:45.669 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-05-12T22:49:45.728 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-12T22:49:45.864 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-05-12T22:49:45.864 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-05-12T22:49:46.041 INFO:teuthology.orchestra.run.smithi040.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:49:46.042 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:49:46.043 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-05-12T22:49:46.043 INFO:teuthology.orchestra.run.smithi040.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-12T22:49:46.043 INFO:teuthology.orchestra.run.smithi040.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-12T22:49:46.044 INFO:teuthology.orchestra.run.smithi040.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-12T22:49:46.044 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-12T22:49:46.044 INFO:teuthology.orchestra.run.smithi040.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T22:49:46.045 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-05-12T22:49:46.045 INFO:teuthology.orchestra.run.smithi040.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-12T22:49:46.045 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-12T22:49:46.045 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-12T22:49:46.054 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-12T22:49:46.085 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-12T22:49:46.086 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T22:49:46.087 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2024-05-12T22:49:46.088 INFO:teuthology.orchestra.run.smithi040.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-12T22:49:46.307 INFO:teuthology.orchestra.run.smithi040.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-12T22:49:46.307 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 55.7 MB of archives. 2024-05-12T22:49:46.307 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-12T22:49:46.307 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-12T22:49:46.381 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-12T22:49:46.516 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:46.642 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:46.776 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-12T22:49:46.939 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-12T22:49:46.955 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-12T22:49:47.081 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-12T22:49:47.082 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:47.289 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-12T22:49:47.364 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-12T22:49:47.573 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-12T22:49:47.583 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-12T22:49:47.588 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-12T22:49:47.658 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:47.671 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:47.910 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:48.129 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T22:49:48.129 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-12T22:49:48.569 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:48.687 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-12T22:49:48.794 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:48.905 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-top (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:48.962 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-12T22:49:49.031 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-12T22:49:49.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-12T22:49:49.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-12T22:49:49.739 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-12T22:49:49.739 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-12T22:49:49.778 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-12T22:49:49.840 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-12T22:49:49.848 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-12T22:49:49.849 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-12T22:49:49.850 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-12T22:49:49.851 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-12T22:49:50.058 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-12T22:49:50.302 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:50.402 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:50.503 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:50.528 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-12T22:49:50.629 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:50.755 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-shell (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:50.881 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:51.441 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2024-05-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2024-05-12T22:49:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2024-05-12T22:49:51.910 INFO:teuthology.orchestra.run.smithi047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-12T22:49:52.053 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-12T22:49:52.378 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-12T22:49:52.865 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-mirror (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:53.211 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T22:49:53.212 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-12T22:49:53.675 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:53.801 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:54.242 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T22:49:54.242 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-12T22:49:54.753 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:55.113 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-12T22:49:55.647 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:55.913 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T22:49:55.913 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-12T22:49:56.416 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:56.641 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T22:49:56.641 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:57.806 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T22:49:57.806 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-12T22:49:58.306 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:58.432 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:58.583 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:58.802 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T22:49:58.803 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-12T22:49:59.267 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:59.393 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:59.494 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:59.620 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-volume (19.0.0-2555-gf72fecff-1jammy) ... 2024-05-12T22:49:59.956 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T22:50:00.082 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T22:50:00.235 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T22:50:01.944 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T22:50:01.947 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-12T22:50:02.005 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-05-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-05-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-05-12T22:50:02.414 INFO:teuthology.orchestra.run.smithi047.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-12T22:50:02.414 INFO:teuthology.orchestra.run.smithi047.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-12T22:50:02.415 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-12T22:50:02.416 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-12T22:50:02.416 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-05-12T22:50:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-12T22:50:02.416 INFO:teuthology.orchestra.run.smithi047.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-12T22:50:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-12T22:50:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-12T22:50:02.417 INFO:teuthology.orchestra.run.smithi047.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T22:50:02.418 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-05-12T22:50:02.418 INFO:teuthology.orchestra.run.smithi047.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-12T22:50:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-12T22:50:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-12T22:50:02.462 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-05-12T22:50:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-12T22:50:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-12T22:50:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-12T22:50:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-12T22:50:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-12T22:50:02.463 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-12T22:50:02.464 INFO:teuthology.orchestra.run.smithi047.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-12T22:50:02.465 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-05-12T22:50:02.465 INFO:teuthology.orchestra.run.smithi047.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-12T22:50:02.903 INFO:teuthology.orchestra.run.smithi047.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-12T22:50:02.904 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 55.7 MB of archives. 2024-05-12T22:50:02.904 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-12T22:50:02.904 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-12T22:50:03.544 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-12T22:50:03.560 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-12T22:50:03.687 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-12T22:50:03.688 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-12T22:50:03.689 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-12T22:50:03.717 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-12T22:50:03.718 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-12T22:50:03.722 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-12T22:50:03.724 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-12T22:50:03.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-12T22:50:03.897 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-12T22:50:04.197 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-12T22:50:04.207 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-12T22:50:04.212 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-12T22:50:04.307 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-12T22:50:15.976 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-12T22:50:15.996 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-12T22:50:16.445 INFO:teuthology.orchestra.run.smithi040.stdout:Preconfiguring packages ... 2024-05-12T22:50:16.599 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 55.7 MB in 30s (1,862 kB/s) 2024-05-12T22:50:16.894 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-12T22:50:16.900 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:17.019 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:17.607 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi040.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-12T22:50:18.799 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package flex. 2024-05-12T22:50:18.875 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-12T22:50:18.880 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:18.914 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-12T22:50:19.431 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T22:50:19.603 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-12T22:50:20.023 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:50:20.550 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-12T22:50:20.556 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:20.661 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:21.070 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T22:50:21.918 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package bison. 2024-05-12T22:50:22.026 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-12T22:50:22.032 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-12T22:50:22.079 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T22:50:22.496 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-12T22:50:22.524 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-12T22:50:22.571 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T22:50:22.874 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package dump. 2024-05-12T22:50:22.890 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-12T22:50:22.924 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking dump (0.4b47-3) ... 2024-05-12T22:50:23.203 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package indent. 2024-05-12T22:50:23.231 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:23.269 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T22:50:23.522 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-12T22:50:23.550 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-12T22:50:23.588 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T22:50:23.876 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-12T22:50:23.904 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-12T22:50:23.942 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T22:50:24.170 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-12T22:50:24.187 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-12T22:50:24.228 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T22:50:24.557 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-12T22:50:24.585 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:24.623 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:24.851 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-12T22:50:24.867 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:24.901 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:25.120 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjson-perl. 2024-05-12T22:50:25.148 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-12T22:50:25.187 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-12T22:50:25.499 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-12T22:50:25.527 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-12T22:50:25.565 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T22:50:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-12T22:50:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T22:50:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-12T22:50:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T22:50:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-12T22:50:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T22:50:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:50:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-12T22:50:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-12T22:50:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T22:50:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-12T22:50:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T22:50:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T22:50:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-12T22:50:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-12T22:50:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:50:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-12T22:50:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:50:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-12T22:50:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T22:50:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:50:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-12T22:50:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-12T22:50:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T22:50:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package modemmanager. 2024-05-12T22:50:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T22:50:31.204 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:50:31.322 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-12T22:50:31.458 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-12T22:50:31.462 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-12T22:50:31.696 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-12T22:50:31.703 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-12T22:50:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager. 2024-05-12T22:50:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T22:50:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-12T22:50:32.236 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-12T22:50:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ppp. 2024-05-12T22:50:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-12T22:50:32.575 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-12T22:50:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T22:50:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pptp-linux. 2024-05-12T22:50:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-12T22:50:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-12T22:50:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-12T22:50:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-12T22:50:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-12T22:50:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-12T22:50:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-12T22:50:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-common (238) ... 2024-05-12T22:50:34.030 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-12T22:50:34.034 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-12T22:50:34.119 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-12T22:50:34.147 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:34.185 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:34.757 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-common. 2024-05-12T22:50:34.785 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-12T22:50:34.843 INFO:teuthology.orchestra.run.smithi040.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-12T22:50:34.863 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-common (238) ... 2024-05-12T22:50:35.297 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-14. 2024-05-12T22:50:35.326 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:35.367 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:36.709 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql. 2024-05-12T22:50:36.739 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-12T22:50:36.775 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql (14+238) ... 2024-05-12T22:50:37.011 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client. 2024-05-12T22:50:37.037 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-12T22:50:37.069 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client (14+238) ... 2024-05-12T22:50:37.263 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-12T22:50:37.280 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-12T22:50:37.321 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-12T22:50:37.591 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-12T22:50:37.615 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-12T22:50:37.641 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl8.6. 2024-05-12T22:50:37.669 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-12T22:50:37.707 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T22:50:38.002 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl. 2024-05-12T22:50:38.030 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-12T22:50:38.073 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-12T22:50:38.363 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package wpasupplicant. 2024-05-12T22:50:38.392 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-12T22:50:38.421 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T22:50:38.801 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-12T22:50:38.830 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-12T22:50:38.867 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-12T22:50:39.245 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-12T22:50:39.274 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-12T22:50:39.321 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T22:50:39.600 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-common (238) ... 2024-05-12T22:50:39.613 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-12T22:50:39.810 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-12T22:50:39.919 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T22:50:40.045 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:40.171 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T22:50:40.306 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T22:50:40.432 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:40.973 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-12T22:50:41.046 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T22:50:41.406 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T22:50:41.406 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T22:50:41.899 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T22:50:42.017 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T22:50:42.118 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:50:42.219 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-12T22:50:42.378 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T22:50:42.504 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:42.630 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T22:50:42.756 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T22:50:43.353 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T22:50:43.374 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-12T22:50:43.479 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up dump (0.4b47-3) ... 2024-05-12T22:50:43.573 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-12T22:50:43.656 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:50:43.782 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T22:50:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-12T22:50:43.908 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-12T22:50:43.961 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-12T22:50:44.013 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-12T22:50:44.034 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-12T22:50:44.065 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-12T22:50:44.135 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T22:50:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-12T22:50:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T22:50:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T22:50:44.589 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T22:50:44.715 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:44.841 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-12T22:50:45.009 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client (14+238) ... 2024-05-12T22:50:45.110 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:which means they are currently configured by ifupdown: 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:- ens1f0 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-12T22:50:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:remove their configuration from /etc/network/interfaces. 2024-05-12T22:50:45.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:45.676 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-12T22:50:45.993 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-12T22:50:46.331 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-12T22:50:46.496 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-12T22:50:46.813 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:46.910 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-12T22:50:46.964 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:47.090 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-12T22:50:47.216 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-common (238) ... 2024-05-12T22:50:47.725 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-12T22:50:47.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-12T22:50:47.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-12T22:50:47.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-12T22:50:47.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-12T22:50:47.727 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-12T22:50:47.755 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-12T22:50:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-12T22:50:48.167 INFO:teuthology.orchestra.run.smithi047.stdout:Preconfiguring packages ... 2024-05-12T22:50:48.319 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 55.7 MB in 45s (1,231 kB/s) 2024-05-12T22:50:48.401 INFO:teuthology.orchestra.run.smithi040.stdout:Adding user postgres to group ssl-cert 2024-05-12T22:50:48.588 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-12T22:50:48.594 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:48.637 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:48.637 INFO:teuthology.orchestra.run.smithi040.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-12T22:50:48.721 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:48.861 INFO:teuthology.orchestra.run.smithi040.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-12T22:50:48.861 INFO:teuthology.orchestra.run.smithi040.stdout:Removing obsolete dictionary files: 2024-05-12T22:50:49.285 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-12T22:50:49.413 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-12T22:50:49.786 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:50:50.100 INFO:teuthology.orchestra.run.smithi040.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-12T22:50:50.113 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-12T22:50:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-12T22:50:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:This user must also own the server process. 2024-05-12T22:50:50.156 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:The database cluster will be initialized with locale "en_US". 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:The default text search configuration will be set to "english". 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:Data page checksums are disabled. 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:creating subdirectories ... ok 2024-05-12T22:50:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:selecting dynamic shared memory implementation ... posix 2024-05-12T22:50:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default max_connections ... 100 2024-05-12T22:50:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default shared_buffers ... 128MB 2024-05-12T22:50:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default time zone ... Etc/UTC 2024-05-12T22:50:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:creating configuration files ... ok 2024-05-12T22:50:50.212 INFO:teuthology.orchestra.run.smithi047.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-12T22:50:50.334 INFO:teuthology.orchestra.run.smithi040.stdout:running bootstrap script ... ok 2024-05-12T22:50:50.469 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package flex. 2024-05-12T22:50:50.573 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-12T22:50:50.579 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:50.625 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-12T22:50:50.961 INFO:teuthology.orchestra.run.smithi040.stdout:performing post-bootstrap initialization ... ok 2024-05-12T22:50:51.053 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T22:50:51.216 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-12T22:50:51.563 INFO:teuthology.orchestra.run.smithi040.stdout:syncing data to disk ... ok 2024-05-12T22:50:51.611 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:50:51.944 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-12T22:50:52.131 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-12T22:50:52.137 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:52.266 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:52.684 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-12T22:50:52.814 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-12T22:50:53.142 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T22:50:53.471 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package bison. 2024-05-12T22:50:53.536 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-12T22:50:53.541 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-12T22:50:53.592 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T22:50:53.992 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-12T22:50:54.020 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-12T22:50:54.059 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T22:50:54.354 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package dump. 2024-05-12T22:50:54.382 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-12T22:50:54.420 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking dump (0.4b47-3) ... 2024-05-12T22:50:54.691 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package indent. 2024-05-12T22:50:54.707 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:50:54.734 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:50:54.749 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T22:50:54.835 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-12T22:50:54.936 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql (14+238) ... 2024-05-12T22:50:55.002 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-12T22:50:55.030 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-12T22:50:55.045 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:50:55.068 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T22:50:55.171 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:50:55.372 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-12T22:50:55.400 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-12T22:50:55.431 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T22:50:55.434 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T22:50:55.434 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T22:50:55.658 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-12T22:50:55.675 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-12T22:50:55.716 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T22:50:55.966 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T22:50:56.053 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-12T22:50:56.057 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-12T22:50:56.081 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:56.120 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:56.360 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T22:50:56.373 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-12T22:50:56.401 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-12T22:50:56.439 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T22:50:56.496 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T22:50:56.675 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjson-perl. 2024-05-12T22:50:56.705 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-12T22:50:56.742 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-12T22:50:57.053 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-12T22:50:57.081 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-12T22:50:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T22:50:57.849 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-12T22:50:57.949 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T22:50:58.457 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T22:50:58.464 DEBUG:teuthology.parallel:result is None 2024-05-12T22:50:58.798 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-12T22:50:58.827 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T22:50:58.864 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:59.125 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-12T22:50:59.142 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-12T22:50:59.455 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:50:59.828 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-12T22:50:59.857 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T22:50:59.895 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:51:00.206 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-12T22:51:00.235 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-12T22:51:00.273 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T22:51:00.592 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-12T22:51:00.620 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T22:51:00.659 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T22:51:01.037 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-12T22:51:01.066 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:51:01.103 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:01.398 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-12T22:51:01.426 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:51:01.457 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:51:01.726 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-12T22:51:01.755 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:51:01.792 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:51:02.036 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-12T22:51:02.065 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-12T22:51:02.103 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:51:02.574 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-12T22:51:02.602 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-12T22:51:02.640 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T22:51:02.960 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package modemmanager. 2024-05-12T22:51:02.988 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-12T22:51:03.026 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:51:03.633 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package network-manager. 2024-05-12T22:51:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-12T22:51:03.699 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-12T22:51:04.324 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ppp. 2024-05-12T22:51:04.352 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-12T22:51:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T22:51:04.945 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pptp-linux. 2024-05-12T22:51:04.973 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-12T22:51:05.012 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-12T22:51:05.281 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-12T22:51:05.310 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-12T22:51:05.356 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-12T22:51:05.659 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-12T22:51:05.688 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-12T22:51:05.726 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client-common (238) ... 2024-05-12T22:51:05.980 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-12T22:51:06.008 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:51:06.046 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:06.626 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-common. 2024-05-12T22:51:06.654 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-12T22:51:06.712 INFO:teuthology.orchestra.run.smithi047.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-12T22:51:06.741 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-common (238) ... 2024-05-12T22:51:07.208 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-14. 2024-05-12T22:51:07.237 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-12T22:51:07.278 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:08.461 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql. 2024-05-12T22:51:08.478 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-12T22:51:08.519 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql (14+238) ... 2024-05-12T22:51:08.746 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client. 2024-05-12T22:51:08.763 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-12T22:51:08.804 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client (14+238) ... 2024-05-12T22:51:09.049 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-12T22:51:09.077 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-12T22:51:09.115 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-12T22:51:09.434 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package tcl8.6. 2024-05-12T22:51:09.463 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-12T22:51:09.501 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T22:51:09.795 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package tcl. 2024-05-12T22:51:09.824 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-12T22:51:09.859 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-12T22:51:10.182 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package wpasupplicant. 2024-05-12T22:51:10.210 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-12T22:51:10.248 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T22:51:10.602 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-12T22:51:10.619 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-12T22:51:10.660 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-12T22:51:11.005 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-12T22:51:11.034 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-12T22:51:11.080 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T22:51:11.360 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client-common (238) ... 2024-05-12T22:51:11.569 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-12T22:51:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-12T22:51:11.822 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:11.948 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-12T22:51:12.049 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-12T22:51:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:12.724 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-12T22:51:12.814 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-12T22:51:13.176 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T22:51:13.177 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-12T22:51:13.633 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-12T22:51:13.759 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-12T22:51:13.885 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-12T22:51:14.036 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-12T22:51:14.162 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-12T22:51:14.288 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-12T22:51:14.414 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-12T22:51:14.524 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-12T22:51:15.146 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-12T22:51:15.272 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up dump (0.4b47-3) ... 2024-05-12T22:51:15.365 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-12T22:51:15.423 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:51:15.524 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-12T22:51:15.625 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-12T22:51:15.751 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-12T22:51:15.877 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-12T22:51:15.968 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-12T22:51:16.037 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-12T22:51:16.163 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-12T22:51:16.323 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-12T22:51:16.441 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:51:16.567 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-12T22:51:16.735 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client (14+238) ... 2024-05-12T22:51:16.860 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-12T22:51:17.334 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-12T22:51:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:which means they are currently configured by ifupdown: 2024-05-12T22:51:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:- ens1f0 2024-05-12T22:51:17.334 INFO:teuthology.orchestra.run.smithi047.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-12T22:51:17.335 INFO:teuthology.orchestra.run.smithi047.stdout:remove their configuration from /etc/network/interfaces. 2024-05-12T22:51:17.335 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:17.456 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-12T22:51:17.764 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-12T22:51:18.085 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-12T22:51:18.571 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-12T22:51:18.714 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-12T22:51:18.816 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-12T22:51:18.917 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-common (238) ... 2024-05-12T22:51:19.772 INFO:teuthology.orchestra.run.smithi047.stdout:Adding user postgres to group ssl-cert 2024-05-12T22:51:20.025 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:20.025 INFO:teuthology.orchestra.run.smithi047.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-12T22:51:20.252 INFO:teuthology.orchestra.run.smithi047.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-12T22:51:20.252 INFO:teuthology.orchestra.run.smithi047.stdout:Removing obsolete dictionary files: 2024-05-12T22:51:20.802 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-12T22:51:21.210 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-12T22:51:21.550 INFO:teuthology.orchestra.run.smithi047.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-12T22:51:21.564 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:This user must also own the server process. 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:The database cluster will be initialized with locale "en_US". 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:The default text search configuration will be set to "english". 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:Data page checksums are disabled. 2024-05-12T22:51:21.617 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-12T22:51:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:creating subdirectories ... ok 2024-05-12T22:51:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:selecting dynamic shared memory implementation ... posix 2024-05-12T22:51:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default max_connections ... 100 2024-05-12T22:51:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default shared_buffers ... 128MB 2024-05-12T22:51:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default time zone ... Etc/UTC 2024-05-12T22:51:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:creating configuration files ... ok 2024-05-12T22:51:21.793 INFO:teuthology.orchestra.run.smithi047.stdout:running bootstrap script ... ok 2024-05-12T22:51:22.442 INFO:teuthology.orchestra.run.smithi047.stdout:performing post-bootstrap initialization ... ok 2024-05-12T22:51:23.086 INFO:teuthology.orchestra.run.smithi047.stdout:syncing data to disk ... ok 2024-05-12T22:51:23.511 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-12T22:51:26.275 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:51:26.401 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-12T22:51:26.526 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql (14+238) ... 2024-05-12T22:51:26.652 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-12T22:51:26.778 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-12T22:51:27.038 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T22:51:27.038 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-12T22:51:27.573 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-12T22:51:27.690 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-12T22:51:27.984 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-12T22:51:28.128 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-12T22:51:29.481 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-12T22:51:29.581 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-12T22:51:30.419 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-12T22:51:30.425 DEBUG:teuthology.parallel:result is None 2024-05-12T22:51:30.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f72fecff68e1d400c4568684327c900485c20d6a 2024-05-12T22:51:30.583 DEBUG:teuthology.orchestra.run.smithi040:> dpkg-query -W -f '${Version}' ceph 2024-05-12T22:51:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:51:30.604 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:51:30.604 INFO:teuthology.task.install:The correct ceph version 19.0.0-2555-gf72fecff-1jammy is installed. 2024-05-12T22:51:30.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f72fecff68e1d400c4568684327c900485c20d6a 2024-05-12T22:51:30.820 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2024-05-12T22:51:30.923 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:51:30.923 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2555-gf72fecff-1jammy 2024-05-12T22:51:30.923 INFO:teuthology.task.install:The correct ceph version 19.0.0-2555-gf72fecff-1jammy is installed. 2024-05-12T22:51:30.925 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-12T22:51:30.925 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:30.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T22:51:30.940 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:30.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-12T22:51:30.982 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-12T22:51:30.982 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:30.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T22:51:30.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T22:51:31.054 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:31.054 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-12T22:51:31.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-12T22:51:31.123 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-12T22:51:31.124 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:31.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T22:51:31.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T22:51:31.190 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:31.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-12T22:51:31.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-12T22:51:31.259 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-12T22:51:31.259 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:31.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T22:51:31.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T22:51:31.326 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:31.326 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-12T22:51:31.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-12T22:51:31.396 INFO:teuthology.run_tasks:Running task ceph... 2024-05-12T22:51:31.485 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-12T22:51:31.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-05-12T22:51:31.488 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-05-12T22:51:31.501 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-12T22:51:31.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-12T22:51:31.543 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-12T22:51:31.556 INFO:tasks.ceph:Creating extra log directories... 2024-05-12T22:51:31.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-12T22:51:31.599 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-12T22:51:31.619 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-12T22:51:31.619 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-12T22:51:31.619 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-12T22:51:31.620 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:31.620 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-12T22:51:31.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-12T22:51:31.734 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:31.735 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-12T22:51:31.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-12T22:51:31.822 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-12T22:51:31.822 INFO:tasks.ceph:config {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-12T22:51:31.822 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995', 'branch': 'squid', 'description': 'fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7703995', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'c50db29d375ad9ca1a200449f9347b89e25fb278'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 521, 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a', 'sleep_before_teardown': 0, 'subset': '295/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_c50db29d375ad9ca1a200449f9347b89e25fb278/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'c50db29d375ad9ca1a200449f9347b89e25fb278', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBBEnzyUeCs9Q6lXGc4M3B0UgYIC82mjWw72QaXP7ezJDBQWXF7tRVmhrU5qUDuYOVqQeLVrgYfjC/vTbZXNSYM=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEJ/lRmCpF4JZ7sp2mhJYS71d39VNBPGbmqDdhz6QJvWaP+eZ2gjZ/PLkw5o1RlNvw99PloHQepVQmpNSucLR4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'f72fecff68e1d400c4568684327c900485c20d6a', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/acl.sh', 'fs/misc/chmod.sh', 'fs/misc/dac_override.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-12_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-12T22:51:31.823 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-12T22:51:31.825 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-12T22:51:31.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-05-12T22:51:31.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-05-12T22:51:31.925 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:31.925 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T22:51:31.930 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T22:51:31.930 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-05-12 22:44:33.009476026 +0000 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-05-12 22:44:32.713478665 +0000 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-05-12 22:44:32.713478665 +0000 2024-05-12T22:51:31.979 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-05-12T22:51:31.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T22:51:32.033 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-05-12T22:51:32.034 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-05-12T22:51:32.034 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000396356 s, 1.3 MB/s 2024-05-12T22:51:32.035 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T22:51:32.085 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-05-12 22:44:33.513471529 +0000 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-05-12 22:44:33.237473991 +0000 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-05-12 22:44:33.237473991 +0000 2024-05-12T22:51:32.135 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-05-12T22:51:32.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T22:51:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-05-12T22:51:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-05-12T22:51:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000414466 s, 1.2 MB/s 2024-05-12T22:51:32.192 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T22:51:32.240 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-05-12 22:44:33.981467354 +0000 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-05-12 22:44:33.725469638 +0000 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-05-12 22:44:33.725469638 +0000 2024-05-12T22:51:32.287 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-05-12T22:51:32.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T22:51:32.341 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-05-12T22:51:32.341 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-05-12T22:51:32.341 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000330122 s, 1.6 MB/s 2024-05-12T22:51:32.342 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T22:51:32.395 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-05-12T22:51:32.442 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-05-12 22:44:34.493462786 +0000 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-05-12 22:44:34.209465321 +0000 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-05-12 22:44:34.209465321 +0000 2024-05-12T22:51:32.443 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-05-12T22:51:32.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T22:51:32.496 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-05-12T22:51:32.497 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-05-12T22:51:32.497 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000307334 s, 1.7 MB/s 2024-05-12T22:51:32.498 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T22:51:32.547 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:32.547 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:32.547 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-12T22:51:32.553 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-12T22:51:32.554 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-12T22:51:32.603 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-12 22:44:29.017161721 +0000 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-12 22:44:28.753164079 +0000 2024-05-12T22:51:32.604 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-12 22:44:28.753164079 +0000 2024-05-12T22:51:32.605 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-12T22:51:32.605 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-12T22:51:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-12T22:51:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-12T22:51:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00031084 s, 1.6 MB/s 2024-05-12T22:51:32.660 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-12T22:51:32.709 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-12T22:51:32.756 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-12 22:44:29.521157220 +0000 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-12 22:44:29.245159685 +0000 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-12 22:44:29.245159685 +0000 2024-05-12T22:51:32.757 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-12T22:51:32.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-12T22:51:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-12T22:51:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-12T22:51:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000202427 s, 2.5 MB/s 2024-05-12T22:51:32.812 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-12T22:51:32.861 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-12 22:44:29.789154825 +0000 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-12 22:44:29.785154861 +0000 2024-05-12T22:51:32.912 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-12 22:44:29.785154861 +0000 2024-05-12T22:51:32.913 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-12T22:51:32.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-12T22:51:32.966 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-12T22:51:32.966 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-12T22:51:32.966 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000196351 s, 2.6 MB/s 2024-05-12T22:51:32.967 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-12T22:51:33.017 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-12 22:44:30.273150502 +0000 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-12 22:44:30.269150538 +0000 2024-05-12T22:51:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-12 22:44:30.269150538 +0000 2024-05-12T22:51:33.065 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-12T22:51:33.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-12T22:51:33.118 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-12T22:51:33.118 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-12T22:51:33.118 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000289558 s, 1.8 MB/s 2024-05-12T22:51:33.120 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-12T22:51:33.169 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:33.169 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-12T22:51:33.169 INFO:tasks.ceph:Generating config... 2024-05-12T22:51:33.170 INFO:tasks.ceph:[client] client acl type = posix_acl 2024-05-12T22:51:33.171 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-12T22:51:33.171 INFO:tasks.ceph:[client] debug client = 20 2024-05-12T22:51:33.171 INFO:tasks.ceph:[client] debug ms = 1 2024-05-12T22:51:33.171 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-12T22:51:33.171 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-12T22:51:33.171 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-12T22:51:33.172 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-12T22:51:33.172 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-12T22:51:33.173 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-12T22:51:33.173 INFO:tasks.ceph:Setting up mon.a... 2024-05-12T22:51:33.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-12T22:51:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-05-12T22:51:33.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-12T22:51:33.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T22:51:33.357 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.47'), ('mon.c', '[v2:172.21.15.47:3301,v1:172.21.15.47:6790]')] 2024-05-12T22:51:33.358 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-12T22:51:33.359 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:33.359 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-12T22:51:33.406 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.47 --addv c '[v2:172.21.15.47:3301,v1:172.21.15.47:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid b0a63ee2-381a-4a33-b1a1-0e740f041feb 2024-05-12T22:51:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:fsid b0a63ee2-381a-4a33-b1a1-0e740f041feb 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-05-12T22:51:33.495385+0000 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-05-12T22:51:33.495385+0000 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 17 (quincy) 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon.c 2024-05-12T22:51:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-12T22:51:33.495 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-12T22:51:33.543 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b0a63ee2-381a-4a33-b1a1-0e740f041feb... 2024-05-12T22:51:33.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-12T22:51:33.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-05-12T22:51:33.623 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-12T22:51:33.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = b0a63ee2-381a-4a33-b1a1-0e740f041feb 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.625 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-05-12T22:51:33.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-05-12T22:51:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore compression mode = aggressive 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-05-12T22:51:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-05-12T22:51:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-05-12T22:51:33.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: client acl type = posix_acl 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-05-12T22:51:33.631 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-05-12T22:51:33.632 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-05-12T22:51:33.633 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-12T22:51:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-12T22:51:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.40,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = b0a63ee2-381a-4a33-b1a1-0e740f041feb 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-12T22:51:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-12T22:51:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore compression mode = aggressive 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-12T22:51:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-12T22:51:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-12T22:51:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-12T22:51:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon down mkfs grace = 300 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: client acl type = posix_acl 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-12T22:51:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-12T22:51:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-12T22:51:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-12T22:51:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-12T22:51:33.645 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-12T22:51:33.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-12T22:51:33.728 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-12T22:51:33.728 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:33.728 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-12T22:51:33.734 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:33.734 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-12T22:51:33.783 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:51:33.783 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:33.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-12T22:51:33.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T22:51:33.884 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:51:33.885 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:33.932 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:51:33.932 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:33.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-12T22:51:33.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-12T22:51:33.956 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:51:33.957 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:34.004 INFO:tasks.ceph:Setting up mon nodes... 2024-05-12T22:51:34.004 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-12T22:51:34.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-12T22:51:34.052 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-12T22:51:34.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-12T22:51:34.100 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-12T22:51:34.115 INFO:tasks.ceph:Setting up mds nodes... 2024-05-12T22:51:34.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-12T22:51:34.158 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-12T22:51:34.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-12T22:51:34.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-12T22:51:34.261 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-12T22:51:34.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-12T22:51:34.276 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-12T22:51:34.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-12T22:51:34.312 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-12T22:51:34.324 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-12T22:51:34.324 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-12T22:51:34.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-12T22:51:34.379 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:34.379 INFO:tasks.ceph:role: osd.0 2024-05-12T22:51:34.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:51:34.380 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-12T22:51:34.442 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:34.443 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:34.889 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-05-12T22:51:34.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-05-12T22:51:34.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-12T22:51:34.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-12T22:51:35.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:35.006 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:35.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-12T22:51:35.062 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:35.063 INFO:tasks.ceph:role: osd.1 2024-05-12T22:51:35.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:51:35.063 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:35.126 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:35.127 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:35.593 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-05-12T22:51:35.595 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-05-12T22:51:35.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-12T22:51:35.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-12T22:51:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:35.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:35.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-12T22:51:35.831 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:35.831 INFO:tasks.ceph:role: osd.2 2024-05-12T22:51:35.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:51:35.831 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:35.897 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:35.898 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:35.898 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:35.898 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:35.898 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:36.380 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-05-12T22:51:36.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-05-12T22:51:36.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-12T22:51:36.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-12T22:51:36.539 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:36.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:36.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-12T22:51:36.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:36.595 INFO:tasks.ceph:role: osd.3 2024-05-12T22:51:36.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:51:36.596 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-12T22:51:36.664 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:36.664 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:36.664 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:36.665 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:37.089 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-05-12T22:51:37.091 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-05-12T22:51:37.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-12T22:51:37.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-12T22:51:37.193 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:37.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:37.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:37.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.304+0000 7fde30b8c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-12T22:51:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.312+0000 7fde30b8c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-12T22:51:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.312+0000 7fde30b8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T22:51:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.312+0000 7fde30b8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T22:51:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.312+0000 7fde30b8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-12T22:51:37.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:37.316+0000 7fde30b8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-12T22:51:40.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-12T22:51:40.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-12T22:51:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-12T22:51:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T22:51:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T22:51:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-12T22:51:40.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:40.396+0000 7f74eefeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-12T22:51:43.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-12T22:51:43.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:43.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-12T22:51:43.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-12T22:51:43.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T22:51:43.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T22:51:43.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-12T22:51:43.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:43.512+0000 7ff29a6a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-12T22:51:46.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-12T22:51:46.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-12T22:51:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-12T22:51:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T22:51:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T22:51:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-12T22:51:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:51:46.632+0000 7fa62c6857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-12T22:51:49.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-12T22:51:49.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-12T22:51:49.699 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:49.699 INFO:tasks.ceph:role: osd.4 2024-05-12T22:51:49.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:51:49.699 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:49.757 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:49.781 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-12T22:51:49.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-12T22:51:49.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-12T22:51:49.840 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-12T22:51:49.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:49.893 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:49.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-12T22:51:49.945 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:49.946 INFO:tasks.ceph:role: osd.5 2024-05-12T22:51:49.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:51:49.946 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-12T22:51:50.001 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:50.002 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:50.025 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-12T22:51:50.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-12T22:51:50.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-12T22:51:50.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-12T22:51:50.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:50.136 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:50.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-12T22:51:50.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:50.190 INFO:tasks.ceph:role: osd.6 2024-05-12T22:51:50.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:51:50.190 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-12T22:51:50.244 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:50.245 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:50.269 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-12T22:51:50.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-12T22:51:50.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-12T22:51:50.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-12T22:51:50.377 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:50.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:50.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-12T22:51:50.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-12T22:51:50.433 INFO:tasks.ceph:role: osd.7 2024-05-12T22:51:50.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:51:50.433 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-12T22:51:50.487 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-12T22:51:50.488 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-12T22:51:50.511 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-12T22:51:50.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-12T22:51:50.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-12T22:51:50.572 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-12T22:51:50.628 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-05-12T22:51:50.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:51:50.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.732+0000 7f27b3c437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.732+0000 7f27b3c437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.732+0000 7f27b3c437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.732+0000 7f27b3c437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.732+0000 7f27b3c437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-12T22:51:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:50.736+0000 7f27b3c437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-12T22:51:53.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-12T22:51:53.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:53.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.808+0000 7f1a65f647c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-12T22:51:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.812+0000 7f1a65f647c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-12T22:51:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.812+0000 7f1a65f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T22:51:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.812+0000 7f1a65f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T22:51:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.812+0000 7f1a65f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-12T22:51:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:53.812+0000 7f1a65f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-12T22:51:56.779 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-12T22:51:56.835 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:51:56.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-12T22:51:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-12T22:51:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T22:51:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T22:51:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-12T22:51:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:51:56.915+0000 7f3208a867c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-12T22:51:59.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-12T22:51:59.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:52:00.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-12T22:52:00.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-12T22:52:00.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T22:52:00.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T22:52:00.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-12T22:52:00.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:00.023+0000 7f03af4da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-12T22:52:01.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:52:01.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:52:02.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-12T22:52:03.001 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-12T22:52:03.001 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-12T22:52:03.016 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-12T22:52:03.069 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-12T22:52:03.126 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-12T22:52:03.181 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-12T22:52:03.238 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-12T22:52:03.294 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.294 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-12T22:52:03.308 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-12T22:52:03.363 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.364 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-12T22:52:03.424 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-12T22:52:03.480 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-12T22:52:03.536 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:03.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-12T22:52:03.593 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:03.593 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-12T22:52:03.599 INFO:tasks.ceph:Adding keys to all mons... 2024-05-12T22:52:03.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-12T22:52:03.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-12T22:52:03.657 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-05-12T22:52:03.657 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2R0Fm+CM4AxAAcCZCP8OfjBJEy83Ku5EtlQ== 2024-05-12T22:52:03.657 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2R0Fm+gCNCRAAMkPrZ5lQO4ZbFZxwoee9vQ== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD5R0FmOauREhAAAi4q/BLtmDRktJ5Yf+FFSQ== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD8R0Fm/CXhFxAAYhwqyqDen2evWMKPza2R8g== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD/R0FmAnrEHhAAoy5n50Lv20aCEjemfDNNOw== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQACSEFmv07rJRAAw4tEZe66kjUmex5bDe9Zxg== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2R0Fm5i0hBhAAiMlJomV5MWoYguhIgwlBmA== 2024-05-12T22:52:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2R0FmjXm5DxAAjzDhrgIMvGJX4y+OECA9rQ== 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAGSEFmRqT6KxAAkTkEyMnN9Y9t7RWXxjbFYQ== 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAJSEFmmYOHMBAAPckZ5Qn3IKVcuzhpbSJoGA== 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAMSEFmDzfXNhAAe7fZKegw8+KhkNjs4eGaEg== 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAQSEFmCRqTARAALAMVFCp/VQisgxCqKS0pLQ== 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-05-12T22:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2R0FmOTzAEhAA9dZmkzJhu1Q+XhcoXAszYg== 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD2R0Fm+CM4AxAAcCZCP8OfjBJEy83Ku5EtlQ== 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD2R0Fm+gCNCRAAMkPrZ5lQO4ZbFZxwoee9vQ== 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD5R0FmOauREhAAAi4q/BLtmDRktJ5Yf+FFSQ== 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-05-12T22:52:03.660 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD8R0Fm/CXhFxAAYhwqyqDen2evWMKPza2R8g== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD/R0FmAnrEHhAAoy5n50Lv20aCEjemfDNNOw== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQACSEFmv07rJRAAw4tEZe66kjUmex5bDe9Zxg== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD2R0Fm5i0hBhAAiMlJomV5MWoYguhIgwlBmA== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD2R0FmjXm5DxAAjzDhrgIMvGJX4y+OECA9rQ== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAGSEFmRqT6KxAAkTkEyMnN9Y9t7RWXxjbFYQ== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAJSEFmmYOHMBAAPckZ5Qn3IKVcuzhpbSJoGA== 2024-05-12T22:52:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-05-12T22:52:03.662 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAMSEFmDzfXNhAAe7fZKegw8+KhkNjs4eGaEg== 2024-05-12T22:52:03.662 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-05-12T22:52:03.662 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAQSEFmCRqTARAALAMVFCp/VQisgxCqKS0pLQ== 2024-05-12T22:52:03.662 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-12T22:52:03.662 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD2R0FmOTzAEhAA9dZmkzJhu1Q+XhcoXAszYg== 2024-05-12T22:52:03.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T22:52:03.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T22:52:03.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T22:52:03.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T22:52:03.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:03.806 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:03.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:03.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:03.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:03.979 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T22:52:04.147 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-12T22:52:04.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T22:52:04.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-12T22:52:04.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.323 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.364 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.408 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.495 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.583 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-12T22:52:04.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-12T22:52:04.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-12T22:52:04.717 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-12T22:52:04.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-12T22:52:04.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T22:52:04.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-12T22:52:04.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-12T22:52:04.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T22:52:04.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-12T22:52:05.006 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-12T22:52:05.057 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-12T22:52:05.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-12T22:52:05.195 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:52:05.198 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-12T22:52:05.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-12T22:52:05.245 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-12T22:52:05.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-12T22:52:05.250 INFO:tasks.ceph.mon.a:Started 2024-05-12T22:52:05.250 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-12T22:52:05.250 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-12T22:52:05.289 INFO:tasks.ceph.mon.b:Started 2024-05-12T22:52:05.290 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-12T22:52:05.290 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-12T22:52:05.292 INFO:tasks.ceph.mon.c:Started 2024-05-12T22:52:05.292 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-12T22:52:05.293 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-12T22:52:05.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-12T22:52:05.295 INFO:tasks.ceph.mgr.y:Started 2024-05-12T22:52:05.295 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-12T22:52:05.295 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-12T22:52:05.298 INFO:tasks.ceph.mgr.x:Started 2024-05-12T22:52:05.298 INFO:tasks.ceph:Setting crush tunables to default 2024-05-12T22:52:05.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-05-12T22:52:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 Processor -- start 2024-05-12T22:52:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 -- start start 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0f740b7290 con 0x7f0f740b7e70 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0f740b60e0 con 0x7f0f740b4720 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f79098640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0f74149480 con 0x7f0f74148ab0 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46776/0 (socket says 172.21.15.40:46776) 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 learned_addr learned my addr 172.21.15.40:0/3795488053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T22:52:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.420+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T22:52:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-12T22:52:05.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:05.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:05.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T22:52:05.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:05.624+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.027+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f72d9d640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-12T22:52:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-12T22:52:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T22:52:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T22:52:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:06.831+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-12T22:52:08.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 msgr2=0x7f0f74148f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T22:52:08.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f74148ab0 0x7f0f74148f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:08.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 msgr2=0x7f0f740b4b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T22:52:08.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.47:3300/0 conn(0x7f0f740b4720 0x7f0f740b4b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:08.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 -- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 msgr2=0x7f0f740b6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-12T22:52:08.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 --2- 172.21.15.40:0/3795488053 >> v2:172.21.15.40:3300/0 conn(0x7f0f740b7e70 0x7f0f740b6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:08.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 -- 172.21.15.40:0/3795488053 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f740b8250 con 0x7f0f600036c0 2024-05-12T22:52:08.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:08.419+0000 7f0f70d99640 1 -- 172.21.15.40:0/3795488053 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6000c090 con 0x7f0f60007330 2024-05-12T22:52:10.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960110650 0 0) 0x7f0f6000c090 con 0x7f0f60007330 2024-05-12T22:52:10.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f54003530 con 0x7f0f60007330 2024-05-12T22:52:10.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518310180 0 0) 0x7f0f740b8250 con 0x7f0f600036c0 2024-05-12T22:52:10.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6000c090 con 0x7f0f600036c0 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3764556690 0 0) 0x7f0f54003530 con 0x7f0f60007330 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 >> v1:172.21.15.40:6789/0 conn(0x7f0f600036c0 legacy=0x7f0f60005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6000d2d0 con 0x7f0f60007330 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f0f5c00f040 con 0x7f0f60007330 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 >> v1:172.21.15.47:6789/0 conn(0x7f0f60007330 legacy=0x7f0f600097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f7359e640 1 -- 172.21.15.40:0/3795488053 reap_dead start 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54003bf0 0x7f0f54003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 0x7f0f54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 0x7f0f5400bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5400c3a0 con 0x7f0f540099c0 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5400c520 con 0x7f0f54004810 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.671+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5400c720 con 0x7f0f54003bf0 2024-05-12T22:52:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54003bf0 0x7f0f54003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 0x7f0f54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 0x7f0f5400bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54003bf0 msgr2=0x7f0f54003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:10.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54003bf0 0x7f0f54003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 msgr2=0x7f0f5400bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:10.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 0x7f0f5400bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7259c640 1 -- 172.21.15.40:0/3795488053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f54003530 con 0x7f0f54004810 2024-05-12T22:52:10.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.675+0000 7f0f7359e640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 0x7f0f5400bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:10.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f7259c640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 0x7f0f54004c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ef80 tx=0x7f0f5c01d7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b6aa04c1cebdd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0af020 con 0x7f0f54004810 2024-05-12T22:52:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a7690 con 0x7f0f54004810 2024-05-12T22:52:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f71d9b640 1 -- 172.21.15.40:0/3795488053 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ebd0 con 0x7f0f54004810 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 -- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 msgr2=0x7f0f54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 0x7f0f54004c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ef80 tx=0x7f0f5c01d7d0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 -- 172.21.15.40:0/3795488053 shutdown_connections 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540099c0 0x7f0f5400bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f54004810 0x7f0f54004c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 --2- 172.21.15.40:0/3795488053 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54003bf0 0x7f0f54003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 -- 172.21.15.40:0/3795488053 >> 172.21.15.40:0/3795488053 conn(0x7f0f7406b490 msgr2=0x7f0f7406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 -- 172.21.15.40:0/3795488053 shutdown_connections 2024-05-12T22:52:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.683+0000 7f0f79098640 1 -- 172.21.15.40:0/3795488053 wait complete. 2024-05-12T22:52:10.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 Processor -- start 2024-05-12T22:52:10.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 -- start start 2024-05-12T22:52:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 0x7f0f74140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f540099c0 0x7f0f7406c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740b5d70 con 0x7f0f54003bf0 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740b5a90 con 0x7f0f540099c0 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f79098640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0f74073000 con 0x7f0f54004810 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f72d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f72d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46736/0 (socket says 172.21.15.40:46736) 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 0x7f0f74140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f72d9d640 1 -- 172.21.15.40:0/182061936 learned_addr learned my addr 172.21.15.40:0/182061936 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:10.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7359e640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f540099c0 0x7f0f7406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 -- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f540099c0 msgr2=0x7f0f7406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f540099c0 0x7f0f7406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 -- 172.21.15.40:0/182061936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 msgr2=0x7f0f74145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f7259c640 1 -- 172.21.15.40:0/182061936 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f741457c0 con 0x7f0f54004810 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.687+0000 7f0f72d9d640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:10.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f7259c640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 0x7f0f74140660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0ad000 tx=0x7f0f5c01a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0ac040 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0ba070 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f741401d0 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a8690 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f74144920 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f5c0b2020 con 0x7f0f54004810 2024-05-12T22:52:10.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f5c0bf460 con 0x7f0f54004810 2024-05-12T22:52:10.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.691+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f74068a40 con 0x7f0f54004810 2024-05-12T22:52:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.703+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0f5c017540 con 0x7f0f54004810 2024-05-12T22:52:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.767+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0f74072330 con 0x7f0f54004810 2024-05-12T22:52:10.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/182061936 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0f5c00ebb0 con 0x7f0f54004810 2024-05-12T22:52:10.781 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-05-12T22:52:10.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 msgr2=0x7f0f74140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:10.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 0x7f0f74140660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0ad000 tx=0x7f0f5c01a5d0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 shutdown_connections 2024-05-12T22:52:10.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f540099c0 0x7f0f7406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f54004810 0x7f0f74140660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 --2- 172.21.15.40:0/182061936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f54003bf0 0x7f0f74145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:10.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 >> 172.21.15.40:0/182061936 conn(0x7f0f7406b490 msgr2=0x7f0f740715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:10.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 shutdown_connections 2024-05-12T22:52:10.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:10.775+0000 7f0f79098640 1 -- 172.21.15.40:0/182061936 wait complete. 2024-05-12T22:52:10.801 INFO:tasks.ceph:check_enable_crimson: False 2024-05-12T22:52:10.801 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-12T22:52:10.801 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:10.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-12T22:52:10.813 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:10.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-12T22:52:10.874 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:10.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-12T22:52:10.875 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:10.871+0000 7eff3ea13180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T22:52:10.886 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:52:10.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-12T22:52:10.945 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:10.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-12T22:52:10.958 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:10.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-12T22:52:10.959 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:10.955+0000 7f101b704180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-12T22:52:11.012 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:11.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-12T22:52:11.068 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-12T22:52:11.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-12T22:52:11.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 59ceb6a6-8ca7-43bf-bdbd-54b273059bb4 0 2024-05-12T22:52:11.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 Processor -- start 2024-05-12T22:52:11.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 -- start start 2024-05-12T22:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc934072e30 0x7fc9340b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340b7470 con 0x7fc9340b3370 2024-05-12T22:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340b4e50 con 0x7fc9340b7090 2024-05-12T22:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc93a66f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340b4c00 con 0x7fc934072e30 2024-05-12T22:52:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc933fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc9340b7090 0x7fc934148860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44376/0 (socket says 172.21.15.47:44376) 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc933fff640 1 -- 172.21.15.47:0/1233645345 learned_addr learned my addr 172.21.15.47:0/1233645345 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc9337fe640 1 --2- 172.21.15.47:0/1233645345 >> v2:172.21.15.40:3300/0 conn(0x7fc934072e30 0x7fc9340b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671275678 0 0) 0x7fc9340b4e50 con 0x7fc9340b7090 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc920003530 con 0x7fc9340b7090 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2758117265 0 0) 0x7fc920003530 con 0x7fc9340b7090 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 >> v2:172.21.15.40:3300/0 conn(0x7fc934072e30 msgr2=0x7fc9340b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 --2- 172.21.15.47:0/1233645345 >> v2:172.21.15.40:3300/0 conn(0x7fc934072e30 0x7fc9340b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 >> v1:172.21.15.40:6789/0 conn(0x7fc9340b3370 legacy=0x7fc9340b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc934148f70 con 0x7fc9340b7090 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.287+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fc92c001a00 con 0x7fc9340b7090 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 >> v1:172.21.15.47:6789/0 conn(0x7fc9340b7090 legacy=0x7fc934148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 0x7fc920003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc920004810 0x7fc920004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200052f0 0x7fc92000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b4c00 con 0x7fc920004810 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc92000c1c0 con 0x7fc9200052f0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc92000c3c0 con 0x7fc9200039c0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 0x7fc920003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc938c0c640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200052f0 0x7fc92000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc9337fe640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc920004810 0x7fc920004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 -- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200052f0 msgr2=0x7fc92000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200052f0 0x7fc92000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 -- 172.21.15.47:0/1233645345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc920004810 msgr2=0x7fc920004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc920004810 0x7fc920004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 -- 172.21.15.47:0/1233645345 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc920003530 con 0x7fc9200039c0 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc9337fe640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc920004810 0x7fc920004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc938c0c640 1 -- 172.21.15.47:0/1233645345 reap_dead start 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc933fff640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 0x7fc920003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc92c002240 tx=0x7fc92c01d300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c21944dd0b5dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00a4a0 con 0x7fc9200039c0 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c0ad650 con 0x7fc9200039c0 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc932ffd640 1 -- 172.21.15.47:0/1233645345 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0ada80 con 0x7fc9200039c0 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 -- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 msgr2=0x7fc920003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 0x7fc920003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc92c002240 tx=0x7fc92c01d300 comp rx=0 tx=0).stop 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 -- 172.21.15.47:0/1233645345 shutdown_connections 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1233645345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9200039c0 0x7fc920003de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 -- 172.21.15.47:0/1233645345 >> 172.21.15.47:0/1233645345 conn(0x7fc9340ba220 msgr2=0x7fc9340b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 -- 172.21.15.47:0/1233645345 shutdown_connections 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.291+0000 7fc93a66f640 1 -- 172.21.15.47:0/1233645345 wait complete. 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 Processor -- start 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- start start 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 0x7fc934142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9341ddc60 0x7fc9341e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b3ae0 con 0x7fc9341ddc60 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b3960 con 0x7fc9200039c0 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340b3c60 con 0x7fc9341de0e0 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc933fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 0x7fc934142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc933fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 0x7fc934142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45324/0 (socket says 172.21.15.47:45324) 2024-05-12T22:52:11.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:49810/0 (socket says 172.21.15.47:49810) 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc933fff640 1 -- 172.21.15.47:0/1299445179 learned_addr learned my addr 172.21.15.47:0/1299445179 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc9337fe640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9341ddc60 0x7fc9341e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 -- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 msgr2=0x7fc934142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 0x7fc934142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 -- 172.21.15.47:0/1299445179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9341ddc60 msgr2=0x7fc9341e11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9341ddc60 0x7fc9341e11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 -- 172.21.15.47:0/1299445179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9341d2650 con 0x7fc9341de0e0 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc938c0c640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc93406c350 tx=0x7fc924001c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240052e0 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924003600 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240054a0 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc934141750 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc934142ef0 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc92400c590 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc92401bab0 con 0x7fc9341de0e0 2024-05-12T22:52:11.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.295+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc934068a40 con 0x7fc9341de0e0 2024-05-12T22:52:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.299+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc924022070 con 0x7fc9341de0e0 2024-05-12T22:52:11.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.379+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "59ceb6a6-8ca7-43bf-bdbd-54b273059bb4", "id": 0} v 0) -- 0x7fc9341d0880 con 0x7fc9341de0e0 2024-05-12T22:52:11.385 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:11.379+0000 7eff3ea13180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T22:52:11.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc930ff9640 1 -- 172.21.15.47:0/1299445179 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59ceb6a6-8ca7-43bf-bdbd-54b273059bb4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc924003d80 con 0x7fc9341de0e0 2024-05-12T22:52:11.387 INFO:teuthology.orchestra.run.smithi047.stdout:0 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 msgr2=0x7fc9341e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc93406c350 tx=0x7fc924001c20 comp rx=0 tx=0).stop 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 shutdown_connections 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9341de0e0 0x7fc9341e1710 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9341ddc60 0x7fc9341e11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 --2- 172.21.15.47:0/1299445179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9200039c0 0x7fc934142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.383+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 >> 172.21.15.47:0/1299445179 conn(0x7fc9340ba220 msgr2=0x7fc9340b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.387+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 shutdown_connections 2024-05-12T22:52:11.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.387+0000 7fc93a66f640 1 -- 172.21.15.47:0/1299445179 wait complete. 2024-05-12T22:52:11.404 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new e67e2478-c6dd-443c-86cf-64aa1af50a92 1 2024-05-12T22:52:11.475 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:11.471+0000 7f101b704180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-12T22:52:11.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 Processor -- start 2024-05-12T22:52:11.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 -- start start 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35100b7d40 0x7f35100b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35100b5f20 0x7f35100b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35100b8120 con 0x7f3510141280 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f351006c990 con 0x7f35100b7d40 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3517364640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f351006cbe0 con 0x7f35100b5f20 2024-05-12T22:52:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35100b5f20 0x7f35100b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3515901640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3510141280 0x7f3510141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44386/0 (socket says 172.21.15.47:44386) 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3515901640 1 -- 172.21.15.47:0/308192484 learned_addr learned my addr 172.21.15.47:0/308192484 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 --2- 172.21.15.47:0/308192484 >> v2:172.21.15.47:3300/0 conn(0x7f35100b5f20 0x7f35100b6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45330/0 (socket says 172.21.15.47:45330) 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3515100640 1 --2- 172.21.15.47:0/308192484 >> v2:172.21.15.40:3300/0 conn(0x7f35100b7d40 0x7f35100b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 -- 172.21.15.47:0/308192484 >> v2:172.21.15.40:3300/0 conn(0x7f35100b7d40 msgr2=0x7f35100b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 --2- 172.21.15.47:0/308192484 >> v2:172.21.15.40:3300/0 conn(0x7f35100b7d40 0x7f35100b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 -- 172.21.15.47:0/308192484 >> v1:172.21.15.47:6789/0 conn(0x7f3510141280 legacy=0x7f3510141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f3507fff640 1 -- 172.21.15.47:0/308192484 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582289479 0 0) 0x7f35100b8120 con 0x7f3510141280 2024-05-12T22:52:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.519+0000 7f35148ff640 1 -- 172.21.15.47:0/308192484 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351006d350 con 0x7f35100b5f20 2024-05-12T22:52:11.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f35148ff640 1 --2- 172.21.15.47:0/308192484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100b5f20 0x7f35100b6ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35000097c0 tx=0x7f350001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec25b3188d8f12f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3507fff640 1 -- 172.21.15.47:0/308192484 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35000ab430 con 0x7f35100b5f20 2024-05-12T22:52:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3507fff640 1 -- 172.21.15.47:0/308192484 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35000b0070 con 0x7f35100b5f20 2024-05-12T22:52:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3507fff640 1 -- 172.21.15.47:0/308192484 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35000ab7f0 con 0x7f35100b5f20 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 -- 172.21.15.47:0/308192484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100b5f20 msgr2=0x7f35100b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 --2- 172.21.15.47:0/308192484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100b5f20 0x7f35100b6ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35000097c0 tx=0x7f350001c430 comp rx=0 tx=0).stop 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 -- 172.21.15.47:0/308192484 shutdown_connections 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 --2- 172.21.15.47:0/308192484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100b5f20 0x7f35100b6ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 --2- 172.21.15.47:0/308192484 >> v2:172.21.15.40:3300/0 conn(0x7f35100b7d40 0x7f35100b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 -- 172.21.15.47:0/308192484 >> 172.21.15.47:0/308192484 conn(0x7f351006b490 msgr2=0x7f351006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 -- 172.21.15.47:0/308192484 shutdown_connections 2024-05-12T22:52:11.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.523+0000 7f3517364640 1 -- 172.21.15.47:0/308192484 wait complete. 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 Processor -- start 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- start start 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 0x7f351013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35100b7d40 0x7f3510133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3510154650 con 0x7f35100b7d40 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3510072f60 con 0x7f3510141280 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f35101547d0 con 0x7f35100b5f20 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515100640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 0x7f351013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45342/0 (socket says 172.21.15.47:45342) 2024-05-12T22:52:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 -- 172.21.15.47:0/1320389786 learned_addr learned my addr 172.21.15.47:0/1320389786 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f35148ff640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35100b7d40 0x7f3510133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 -- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 msgr2=0x7f351013bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 0x7f351013bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 -- 172.21.15.47:0/1320389786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35100b7d40 msgr2=0x7f3510133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35100b7d40 0x7f3510133aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 -- 172.21.15.47:0/1320389786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351013d750 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515100640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 0x7f351013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3515901640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f350800c7d0 tx=0x7f350800cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508018070 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350800a5e0 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351013da30 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350800aa10 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35101517d0 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f350801b070 con 0x7f3510141280 2024-05-12T22:52:11.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f350801d7f0 con 0x7f3510141280 2024-05-12T22:52:11.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.527+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3510068a40 con 0x7f3510141280 2024-05-12T22:52:11.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.531+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3508007930 con 0x7f3510141280 2024-05-12T22:52:11.572 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:11.567+0000 7eff3ea13180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T22:52:11.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.599+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e67e2478-c6dd-443c-86cf-64aa1af50a92", "id": 1} v 0) -- 0x7f351013faa0 con 0x7f3510141280 2024-05-12T22:52:11.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3505ffb640 1 -- 172.21.15.47:0/1320389786 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e67e2478-c6dd-443c-86cf-64aa1af50a92", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f350800ac80 con 0x7f3510141280 2024-05-12T22:52:11.606 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-12T22:52:11.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 msgr2=0x7f3510133fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f350800c7d0 tx=0x7f350800cc90 comp rx=0 tx=0).stop 2024-05-12T22:52:11.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 shutdown_connections 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3510141280 0x7f3510133fe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35100b7d40 0x7f3510133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 --2- 172.21.15.47:0/1320389786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35100b5f20 0x7f351013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 >> 172.21.15.47:0/1320389786 conn(0x7f351006b490 msgr2=0x7f351013ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 shutdown_connections 2024-05-12T22:52:11.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.603+0000 7f3517364640 1 -- 172.21.15.47:0/1320389786 wait complete. 2024-05-12T22:52:11.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 9c3f5029-4b6c-4553-ba53-622cd0d90cc4 2 2024-05-12T22:52:11.686 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:11.683+0000 7f101b704180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-12T22:52:11.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.731+0000 7fd718411640 1 Processor -- start 2024-05-12T22:52:11.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.731+0000 7fd718411640 1 -- start start 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd718411640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd718411640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 0x7fd710144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd718411640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7100676b0 con 0x7fd7100672d0 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd718411640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd7100aff30 con 0x7fd710144650 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd718411640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd7100af070 con 0x7fd710147d10 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:49822/0 (socket says 172.21.15.47:49822) 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 -- 172.21.15.47:0/316320207 learned_addr learned my addr 172.21.15.47:0/316320207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7169ae640 1 --2- 172.21.15.47:0/316320207 >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 0x7fd710144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 -- 172.21.15.47:0/316320207 >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 msgr2=0x7fd710144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 --2- 172.21.15.47:0/316320207 >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 0x7fd710144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 -- 172.21.15.47:0/316320207 >> v1:172.21.15.47:6789/0 conn(0x7fd7100672d0 legacy=0x7fd710147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 -- 172.21.15.47:0/316320207 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7100ada00 con 0x7fd710147d10 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7169ae640 1 --2- 172.21.15.47:0/316320207 >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 0x7fd710144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:11.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7151ab640 1 -- 172.21.15.47:0/316320207 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013503174 0 0) 0x7fd7100676b0 con 0x7fd7100672d0 2024-05-12T22:52:11.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7159ac640 1 --2- 172.21.15.47:0/316320207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd7000098a0 tx=0x7fd70001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf8b43d2e25b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7151ab640 1 -- 172.21.15.47:0/316320207 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b1070 con 0x7fd710147d10 2024-05-12T22:52:11.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7151ab640 1 -- 172.21.15.47:0/316320207 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7000ac640 con 0x7fd710147d10 2024-05-12T22:52:11.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.735+0000 7fd7151ab640 1 -- 172.21.15.47:0/316320207 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000aca10 con 0x7fd710147d10 2024-05-12T22:52:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/316320207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 msgr2=0x7fd7100aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- 172.21.15.47:0/316320207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd7000098a0 tx=0x7fd70001c420 comp rx=0 tx=0).stop 2024-05-12T22:52:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/316320207 shutdown_connections 2024-05-12T22:52:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- 172.21.15.47:0/316320207 >> v2:172.21.15.47:3300/0 conn(0x7fd710144650 0x7fd710144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- 172.21.15.47:0/316320207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100aea50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/316320207 >> 172.21.15.47:0/316320207 conn(0x7fd71006b2c0 msgr2=0x7fd71006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/316320207 shutdown_connections 2024-05-12T22:52:11.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/316320207 wait complete. 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 Processor -- start 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- start start 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd710144650 0x7fd7100b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd710154880 con 0x7fd710144650 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd710154700 con 0x7fd7100672d0 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd710154a00 con 0x7fd710147d10 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7169ae640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45360/0 (socket says 172.21.15.47:45360) 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 -- 172.21.15.47:0/271842893 learned_addr learned my addr 172.21.15.47:0/271842893 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7159ac640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd710144650 0x7fd7100b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 -- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 msgr2=0x7fd7100b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 -- 172.21.15.47:0/271842893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd710144650 msgr2=0x7fd7100b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd710144650 0x7fd7100b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 -- 172.21.15.47:0/271842893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7100b3260 con 0x7fd7100672d0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7169ae640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd7161ad640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c480 tx=0x7fd70c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c017070 con 0x7fd7100672d0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c005480 con 0x7fd7100672d0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd710149690 con 0x7fd7100672d0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003840 con 0x7fd7100672d0 2024-05-12T22:52:11.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7100b37e0 con 0x7fd7100672d0 2024-05-12T22:52:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd710068a40 con 0x7fd7100672d0 2024-05-12T22:52:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd70c01a070 con 0x7fd7100672d0 2024-05-12T22:52:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.739+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd70c012820 con 0x7fd7100672d0 2024-05-12T22:52:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.743+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd70c021070 con 0x7fd7100672d0 2024-05-12T22:52:11.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.811+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c3f5029-4b6c-4553-ba53-622cd0d90cc4", "id": 2} v 0) -- 0x7fd71006c360 con 0x7fd7100672d0 2024-05-12T22:52:11.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd706ffd640 1 -- 172.21.15.47:0/271842893 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c3f5029-4b6c-4553-ba53-622cd0d90cc4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd70c0124d0 con 0x7fd7100672d0 2024-05-12T22:52:11.821 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 msgr2=0x7fd7100b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c480 tx=0x7fd70c00c940 comp rx=0 tx=0).stop 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 shutdown_connections 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd710147d10 0x7fd7100b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd710144650 0x7fd7100b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 --2- 172.21.15.47:0/271842893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7100672d0 0x7fd7100b06f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 >> 172.21.15.47:0/271842893 conn(0x7fd71006b2c0 msgr2=0x7fd710143070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 shutdown_connections 2024-05-12T22:52:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.819+0000 7fd718411640 1 -- 172.21.15.47:0/271842893 wait complete. 2024-05-12T22:52:11.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 9bd43011-db63-465f-8acb-8116fe529703 3 2024-05-12T22:52:11.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 Processor -- start 2024-05-12T22:52:11.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 -- start start 2024-05-12T22:52:11.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 0x7f209c147830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f209c147d70 0x7f209c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0702b0 con 0x7f209c067330 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0738e0 con 0x7f209c06c6f0 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f20a21a9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0b3320 con 0x7f209c147d70 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.951+0000 7f209bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f209c147d70 0x7f209c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f209c147d70 0x7f209c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45362/0 (socket says 172.21.15.47:45362) 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 -- 172.21.15.47:0/2227882235 learned_addr learned my addr 172.21.15.47:0/2227882235 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209affd640 1 --2- 172.21.15.47:0/2227882235 >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 0x7f209c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 -- 172.21.15.47:0/2227882235 >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 msgr2=0x7f209c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 --2- 172.21.15.47:0/2227882235 >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 0x7f209c147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 -- 172.21.15.47:0/2227882235 >> v1:172.21.15.40:6789/0 conn(0x7f209c067330 legacy=0x7f209c13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 -- 172.21.15.47:0/2227882235 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c148200 con 0x7f209c147d70 2024-05-12T22:52:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209affd640 1 --2- 172.21.15.47:0/2227882235 >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 0x7f209c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209bfff640 1 --2- 172.21.15.47:0/2227882235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c147d70 0x7f209c14ebc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f209c0700f0 tx=0x7f208c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6327c157016f161a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209a7fc640 1 -- 172.21.15.47:0/2227882235 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0a56c0 con 0x7f209c147d70 2024-05-12T22:52:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209a7fc640 1 -- 172.21.15.47:0/2227882235 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0a5860 con 0x7f209c147d70 2024-05-12T22:52:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f209a7fc640 1 -- 172.21.15.47:0/2227882235 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0a5c30 con 0x7f209c147d70 2024-05-12T22:52:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 -- 172.21.15.47:0/2227882235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c147d70 msgr2=0x7f209c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 --2- 172.21.15.47:0/2227882235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c147d70 0x7f209c14ebc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f209c0700f0 tx=0x7f208c01c9f0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 -- 172.21.15.47:0/2227882235 shutdown_connections 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 --2- 172.21.15.47:0/2227882235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c147d70 0x7f209c14ebc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 --2- 172.21.15.47:0/2227882235 >> v2:172.21.15.40:3300/0 conn(0x7f209c06c6f0 0x7f209c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 -- 172.21.15.47:0/2227882235 >> 172.21.15.47:0/2227882235 conn(0x7f209c06b2c0 msgr2=0x7f209c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 -- 172.21.15.47:0/2227882235 shutdown_connections 2024-05-12T22:52:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.955+0000 7f20a21a9640 1 -- 172.21.15.47:0/2227882235 wait complete. 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 Processor -- start 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- start start 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 0x7f209c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 0x7f209c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0b26b0 con 0x7f209c06c6f0 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0b2530 con 0x7f209c067330 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f209c13e7b0 con 0x7f209c147d70 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 0x7f209c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:49848/0 (socket says 172.21.15.47:49848) 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 -- 172.21.15.47:0/1504373453 learned_addr learned my addr 172.21.15.47:0/1504373453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209affd640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 0x7f209c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 -- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 msgr2=0x7f209c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 0x7f209c146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 -- 172.21.15.47:0/1504373453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 msgr2=0x7f209c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 0x7f209c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 -- 172.21.15.47:0/1504373453 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c144770 con 0x7f209c147d70 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209b7fe640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 0x7f209c146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209affd640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 0x7f209c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f209bfff640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f208c019600 tx=0x7f208c019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0bc020 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0b8690 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c009510 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c144a10 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c141e90 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f208c0bf020 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f208c0b6440 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.959+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c068a40 con 0x7f209c147d70 2024-05-12T22:52:11.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:11.963+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f208c0c6030 con 0x7f209c147d70 2024-05-12T22:52:12.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.031+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9bd43011-db63-465f-8acb-8116fe529703", "id": 3} v 0) -- 0x7f209c1451e0 con 0x7f209c147d70 2024-05-12T22:52:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f2093fff640 1 -- 172.21.15.47:0/1504373453 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bd43011-db63-465f-8acb-8116fe529703", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f208c0165e0 con 0x7f209c147d70 2024-05-12T22:52:12.043 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 msgr2=0x7f209c13a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f208c019600 tx=0x7f208c019790 comp rx=0 tx=0).stop 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 shutdown_connections 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f209c147d70 0x7f209c13a8f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f209c06c6f0 0x7f209c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 --2- 172.21.15.47:0/1504373453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209c067330 0x7f209c146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 >> 172.21.15.47:0/1504373453 conn(0x7f209c06b2c0 msgr2=0x7f209c070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 shutdown_connections 2024-05-12T22:52:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.039+0000 7f20a21a9640 1 -- 172.21.15.47:0/1504373453 wait complete. 2024-05-12T22:52:12.057 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 46fb748d-c27a-4be5-a6f8-8d3543445f08 4 2024-05-12T22:52:12.139 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.135+0000 7eff3ea13180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T22:52:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 Processor -- start 2024-05-12T22:52:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 -- start start 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d580672d0 0x7f7d58145510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 0x7f7d58145a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7d58073470 con 0x7f7d580672d0 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5813fa60 con 0x7f7d580721e0 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d60697640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580676b0 con 0x7f7d5813f070 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5dc32640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 0x7f7d58145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45796/0 (socket says 172.21.15.47:45796) 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 -- 172.21.15.47:0/1486376462 learned_addr learned my addr 172.21.15.47:0/1486376462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5dc32640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 0x7f7d58145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45392/0 (socket says 172.21.15.47:45392) 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5e433640 1 --2- 172.21.15.47:0/1486376462 >> v2:172.21.15.40:3300/0 conn(0x7f7d580672d0 0x7f7d58145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 -- 172.21.15.47:0/1486376462 >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 msgr2=0x7f7d58145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 --2- 172.21.15.47:0/1486376462 >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 0x7f7d58145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 -- 172.21.15.47:0/1486376462 >> v2:172.21.15.40:3300/0 conn(0x7f7d580672d0 msgr2=0x7f7d58145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 --2- 172.21.15.47:0/1486376462 >> v2:172.21.15.40:3300/0 conn(0x7f7d580672d0 0x7f7d58145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.167+0000 7f7d5ec34640 1 -- 172.21.15.47:0/1486376462 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d58072e20 con 0x7f7d5813f070 2024-05-12T22:52:12.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d5ec34640 1 --2- 172.21.15.47:0/1486376462 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d58067cb0 tx=0x7f7d5001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c135ba8057fabfac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d5d431640 1 -- 172.21.15.47:0/1486376462 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500a56f0 con 0x7f7d5813f070 2024-05-12T22:52:12.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d5d431640 1 -- 172.21.15.47:0/1486376462 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d500a5890 con 0x7f7d5813f070 2024-05-12T22:52:12.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d5d431640 1 -- 172.21.15.47:0/1486376462 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500a5c60 con 0x7f7d5813f070 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 -- 172.21.15.47:0/1486376462 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 msgr2=0x7f7d5813f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 --2- 172.21.15.47:0/1486376462 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d58067cb0 tx=0x7f7d5001c960 comp rx=0 tx=0).stop 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 -- 172.21.15.47:0/1486376462 shutdown_connections 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 --2- 172.21.15.47:0/1486376462 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d5813f070 0x7f7d5813f520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 --2- 172.21.15.47:0/1486376462 >> v2:172.21.15.47:3300/0 conn(0x7f7d580721e0 0x7f7d58145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 --2- 172.21.15.47:0/1486376462 >> v2:172.21.15.40:3300/0 conn(0x7f7d580672d0 0x7f7d58145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 -- 172.21.15.47:0/1486376462 >> 172.21.15.47:0/1486376462 conn(0x7f7d5806b2c0 msgr2=0x7f7d5806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 -- 172.21.15.47:0/1486376462 shutdown_connections 2024-05-12T22:52:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.171+0000 7f7d60697640 1 -- 172.21.15.47:0/1486376462 wait complete. 2024-05-12T22:52:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 Processor -- start 2024-05-12T22:52:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- start start 2024-05-12T22:52:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d580672d0 0x7f7d580ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 0x7f7d581e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b5700 con 0x7f7d580672d0 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b5580 con 0x7f7d5813f070 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b5880 con 0x7f7d580721e0 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5ec34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 0x7f7d581e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45800/0 (socket says 172.21.15.47:45800) 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 -- 172.21.15.47:0/4115803471 learned_addr learned my addr 172.21.15.47:0/4115803471 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5e433640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d580672d0 0x7f7d580ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 -- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 msgr2=0x7f7d581e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 0x7f7d581e2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 -- 172.21.15.47:0/4115803471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d580672d0 msgr2=0x7f7d580ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d580672d0 0x7f7d580ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 -- 172.21.15.47:0/4115803471 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5813bf10 con 0x7f7d580721e0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5ec34640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 0x7f7d581e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d5dc32640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400e930 tx=0x7f7d5400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54017070 con 0x7f7d580721e0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5400ca00 con 0x7f7d580721e0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400cdb0 con 0x7f7d580721e0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d580ae030 con 0x7f7d580721e0 2024-05-12T22:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5813b9f0 con 0x7f7d580721e0 2024-05-12T22:52:12.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d5401a070 con 0x7f7d580721e0 2024-05-12T22:52:12.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7d540066b0 con 0x7f7d580721e0 2024-05-12T22:52:12.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.175+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5814fa00 con 0x7f7d580721e0 2024-05-12T22:52:12.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.179+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7d5814fa00 con 0x7f7d580721e0 2024-05-12T22:52:12.195 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.191+0000 7eff3ea13180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T22:52:12.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.247+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46fb748d-c27a-4be5-a6f8-8d3543445f08", "id": 4} v 0) -- 0x7f7d58068a40 con 0x7f7d580721e0 2024-05-12T22:52:12.251 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.247+0000 7eff3ea13180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T22:52:12.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d4effd640 1 -- 172.21.15.47:0/4115803471 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46fb748d-c27a-4be5-a6f8-8d3543445f08", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7d540060f0 con 0x7f7d580721e0 2024-05-12T22:52:12.259 INFO:teuthology.orchestra.run.smithi047.stdout:4 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 msgr2=0x7f7d5813b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400e930 tx=0x7f7d5400edf0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 shutdown_connections 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d5813f070 0x7f7d581e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7d580721e0 0x7f7d5813b350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 --2- 172.21.15.47:0/4115803471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d580672d0 0x7f7d580ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 >> 172.21.15.47:0/4115803471 conn(0x7f7d5806b2c0 msgr2=0x7f7d58145510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.255+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 shutdown_connections 2024-05-12T22:52:12.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.259+0000 7f7d60697640 1 -- 172.21.15.47:0/4115803471 wait complete. 2024-05-12T22:52:12.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new b517cfd6-acf2-4ad9-9c41-78aa9294a4d8 5 2024-05-12T22:52:12.278 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.275+0000 7f101b704180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-12T22:52:12.330 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.327+0000 7eff3ea13180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T22:52:12.336 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.335+0000 7f101b704180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-12T22:52:12.384 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.379+0000 7eff3ea13180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T22:52:12.393 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.391+0000 7f101b704180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-12T22:52:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 Processor -- start 2024-05-12T22:52:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 -- start start 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26d8145a10 0x7f26d8150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d8070460 con 0x7f26d80b5ac0 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d80711f0 con 0x7f26d806c2d0 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.395+0000 7f26dec57640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f26d8070f10 con 0x7f26d8145a10 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f26d806c2d0 0x7f26d813f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57726/0 (socket says 172.21.15.47:57726) 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 -- 172.21.15.47:0/2974111971 learned_addr learned my addr 172.21.15.47:0/2974111971 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dd1f4640 1 --2- 172.21.15.47:0/2974111971 >> v2:172.21.15.40:3300/0 conn(0x7f26d8145a10 0x7f26d8150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763279697 0 0) 0x7f26d80711f0 con 0x7f26d806c2d0 2024-05-12T22:52:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c4003530 con 0x7f26d806c2d0 2024-05-12T22:52:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2598394869 0 0) 0x7f26c4003530 con 0x7f26d806c2d0 2024-05-12T22:52:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 >> v2:172.21.15.40:3300/0 conn(0x7f26d8145a10 msgr2=0x7f26d8150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 --2- 172.21.15.47:0/2974111971 >> v2:172.21.15.40:3300/0 conn(0x7f26d8145a10 0x7f26d8150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 >> v1:172.21.15.40:6789/0 conn(0x7f26d80b5ac0 legacy=0x7f26d8145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d80b5680 con 0x7f26d806c2d0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f26c8001680 con 0x7f26d806c2d0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 >> v1:172.21.15.47:6789/0 conn(0x7f26d806c2d0 legacy=0x7f26d813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 0x7f26c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26c4004810 0x7f26c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40052f0 0x7f26c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8070f10 con 0x7f26c4004810 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f26c400c1c0 con 0x7f26c40052f0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f26c400c3c0 con 0x7f26c40039c0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 0x7f26c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dd1f4640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40052f0 0x7f26c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d7fff640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26c4004810 0x7f26c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 -- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40052f0 msgr2=0x7f26c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40052f0 0x7f26c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 -- 172.21.15.47:0/2974111971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26c4004810 msgr2=0x7f26c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26c4004810 0x7f26c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dc9f3640 1 -- 172.21.15.47:0/2974111971 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4003530 con 0x7f26c40039c0 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dd1f4640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40052f0 0x7f26c400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26d7fff640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26c4004810 0x7f26c4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.399+0000 7f26dd1f4640 1 -- 172.21.15.47:0/2974111971 reap_dead start 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dc9f3640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 0x7f26c4003de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c210 tx=0x7f26c801cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1064cf18531db90d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8007d20 con 0x7f26c40039c0 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c80a9070 con 0x7f26c40039c0 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d77fe640 1 -- 172.21.15.47:0/2974111971 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8005da0 con 0x7f26c40039c0 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 msgr2=0x7f26c4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 0x7f26c4003de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c210 tx=0x7f26c801cbc0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- 172.21.15.47:0/2974111971 shutdown_connections 2024-05-12T22:52:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 --2- 172.21.15.47:0/2974111971 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26c40039c0 0x7f26c4003de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- 172.21.15.47:0/2974111971 >> 172.21.15.47:0/2974111971 conn(0x7f26d80b60a0 msgr2=0x7f26d80b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- 172.21.15.47:0/2974111971 shutdown_connections 2024-05-12T22:52:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- 172.21.15.47:0/2974111971 wait complete. 2024-05-12T22:52:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 Processor -- start 2024-05-12T22:52:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- start start 2024-05-12T22:52:12.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 0x7f26d81418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8142370 0x7f26d8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8145890 con 0x7f26d8142370 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8145710 con 0x7f26c40039c0 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dec57640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f26d81488f0 con 0x7f26d8140210 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dc9f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 0x7f26d81418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dc9f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45410/0 (socket says 172.21.15.47:45410) 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dc9f3640 1 -- 172.21.15.47:0/1101843390 learned_addr learned my addr 172.21.15.47:0/1101843390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dd1f4640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8142370 0x7f26d8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 -- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 msgr2=0x7f26d81dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 -- 172.21.15.47:0/1101843390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8142370 msgr2=0x7f26d8138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8142370 0x7f26d8138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 -- 172.21.15.47:0/1101843390 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d8141e00 con 0x7f26d8140210 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26dc9f3640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d7fff640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 0x7f26d81418c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26d8062ea0 tx=0x7f26c000e820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0019070 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.403+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00052e0 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d8137720 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003840 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d81413a0 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26c00039e0 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f26c0003cd0 con 0x7f26d8140210 2024-05-12T22:52:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d8140690 con 0x7f26d8140210 2024-05-12T22:52:12.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.407+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f26d8141e00 con 0x7f26d8140210 2024-05-12T22:52:12.464 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.459+0000 7eff3ea13180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T22:52:12.488 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.487+0000 7f101b704180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-12T22:52:12.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.487+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b517cfd6-acf2-4ad9-9c41-78aa9294a4d8", "id": 5} v 0) -- 0x7f26d81440d0 con 0x7f26d8140210 2024-05-12T22:52:12.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.491+0000 7f26d57fa640 1 -- 172.21.15.47:0/1101843390 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b517cfd6-acf2-4ad9-9c41-78aa9294a4d8", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f26c0014ca0 con 0x7f26d8140210 2024-05-12T22:52:12.497 INFO:teuthology.orchestra.run.smithi047.stdout:5 2024-05-12T22:52:12.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 msgr2=0x7f26d81418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 0x7f26d81418c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26d8062ea0 tx=0x7f26c000e820 comp rx=0 tx=0).stop 2024-05-12T22:52:12.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 shutdown_connections 2024-05-12T22:52:12.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8142370 0x7f26d8138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26d8140210 0x7f26d81418c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 --2- 172.21.15.47:0/1101843390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26c40039c0 0x7f26d81dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 >> 172.21.15.47:0/1101843390 conn(0x7f26d80b60a0 msgr2=0x7f26d8143350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 shutdown_connections 2024-05-12T22:52:12.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.495+0000 7f26dec57640 1 -- 172.21.15.47:0/1101843390 wait complete. 2024-05-12T22:52:12.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 8738813f-2581-4b6c-8c42-42cad388606c 6 2024-05-12T22:52:12.520 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.515+0000 7eff3ea13180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T22:52:12.547 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.543+0000 7f101b704180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-12T22:52:12.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.631+0000 7f571b21b640 1 Processor -- start 2024-05-12T22:52:12.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.631+0000 7f571b21b640 1 -- start start 2024-05-12T22:52:12.636 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f101b704180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f571b21b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f571b21b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f571406c6f0 0x7f571413e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f571b21b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57140702b0 con 0x7f5714147830 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f571b21b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f57140738e0 con 0x7f571406c6f0 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f571b21b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f57140b3320 con 0x7f5714067330 2024-05-12T22:52:12.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45822/0 (socket says 172.21.15.47:45822) 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 -- 172.21.15.47:0/2614245960 learned_addr learned my addr 172.21.15.47:0/2614245960 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5713fff640 1 --2- 172.21.15.47:0/2614245960 >> v2:172.21.15.40:3300/0 conn(0x7f571406c6f0 0x7f571413e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 -- 172.21.15.47:0/2614245960 >> v2:172.21.15.40:3300/0 conn(0x7f571406c6f0 msgr2=0x7f571413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 --2- 172.21.15.47:0/2614245960 >> v2:172.21.15.40:3300/0 conn(0x7f571406c6f0 0x7f571413e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 -- 172.21.15.47:0/2614245960 >> v1:172.21.15.40:6789/0 conn(0x7f5714147830 legacy=0x7f57140b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.635+0000 7f5718fb7640 1 -- 172.21.15.47:0/2614245960 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57140b28d0 con 0x7f5714067330 2024-05-12T22:52:12.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5718fb7640 1 --2- 172.21.15.47:0/2614245960 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f570c009e50 tx=0x7f570c01eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87b9d92f5618619 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57137fe640 1 -- 172.21.15.47:0/2614245960 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a7800 con 0x7f5714067330 2024-05-12T22:52:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57137fe640 1 -- 172.21.15.47:0/2614245960 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0a79a0 con 0x7f5714067330 2024-05-12T22:52:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57137fe640 1 -- 172.21.15.47:0/2614245960 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a7d70 con 0x7f5714067330 2024-05-12T22:52:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- 172.21.15.47:0/2614245960 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 msgr2=0x7f571413e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- 172.21.15.47:0/2614245960 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f570c009e50 tx=0x7f570c01eb70 comp rx=0 tx=0).stop 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- 172.21.15.47:0/2614245960 shutdown_connections 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- 172.21.15.47:0/2614245960 >> v2:172.21.15.40:3300/0 conn(0x7f571406c6f0 0x7f571413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- 172.21.15.47:0/2614245960 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f571413e0a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- 172.21.15.47:0/2614245960 >> 172.21.15.47:0/2614245960 conn(0x7f571406b2c0 msgr2=0x7f571406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- 172.21.15.47:0/2614245960 shutdown_connections 2024-05-12T22:52:12.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- 172.21.15.47:0/2614245960 wait complete. 2024-05-12T22:52:12.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 Processor -- start 2024-05-12T22:52:12.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- start start 2024-05-12T22:52:12.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 0x7f57141dc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57140b0970 con 0x7f5714147830 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57140b07f0 con 0x7f571406c6f0 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f571b21b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f57140b0af0 con 0x7f5714067330 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5718fb7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5718fb7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:45832/0 (socket says 172.21.15.47:45832) 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45420/0 (socket says 172.21.15.47:45420) 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5718fb7640 1 -- 172.21.15.47:0/792919719 learned_addr learned my addr 172.21.15.47:0/792919719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57197b8640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 0x7f57141dc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 -- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 msgr2=0x7f5714144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 -- 172.21.15.47:0/792919719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 msgr2=0x7f57141dc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 0x7f57141dc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 -- 172.21.15.47:0/792919719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57141df9c0 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5718fb7640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57197b8640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 0x7f57141dc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f5713fff640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f570800d5a0 tx=0x7f570800da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.639+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708019070 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5708004240 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57141dfc70 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708003620 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57141424e0 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f570801c070 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5708012420 con 0x7f571406c6f0 2024-05-12T22:52:12.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5714068a40 con 0x7f571406c6f0 2024-05-12T22:52:12.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.643+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f570801e980 con 0x7f571406c6f0 2024-05-12T22:52:12.678 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.671+0000 7eff3ea13180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T22:52:12.699 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.695+0000 7f101b704180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-12T22:52:12.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.711+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8738813f-2581-4b6c-8c42-42cad388606c", "id": 6} v 0) -- 0x7f57140b90d0 con 0x7f571406c6f0 2024-05-12T22:52:12.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f57117fa640 1 -- 172.21.15.47:0/792919719 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8738813f-2581-4b6c-8c42-42cad388606c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f570801eb60 con 0x7f571406c6f0 2024-05-12T22:52:12.722 INFO:teuthology.orchestra.run.smithi047.stdout:6 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 msgr2=0x7f57141df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f570800d5a0 tx=0x7f570800da60 comp rx=0 tx=0).stop 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 shutdown_connections 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5714147830 0x7f57141dc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f571406c6f0 0x7f57141df480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 --2- 172.21.15.47:0/792919719 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5714067330 0x7f5714144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 >> 172.21.15.47:0/792919719 conn(0x7f571406b2c0 msgr2=0x7f57140b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 shutdown_connections 2024-05-12T22:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.719+0000 7f571b21b640 1 -- 172.21.15.47:0/792919719 wait complete. 2024-05-12T22:52:12.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6 7 2024-05-12T22:52:12.740 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:12.735+0000 7eff3ea13180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T22:52:12.861 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.859+0000 7f101b704180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-12T22:52:12.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 Processor -- start 2024-05-12T22:52:12.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 -- start start 2024-05-12T22:52:12.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06d00672d0 0x7f06d01489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d006c6f0 0x7f06d0148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d00676b0 con 0x7f06d013ef90 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06d0072ea0 con 0x7f06d00672d0 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d6d23640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f06d0073180 con 0x7f06d006c6f0 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d4abf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06d00672d0 0x7f06d01489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06cffff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d006c6f0 0x7f06d0148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.895+0000 7f06d4abf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06d00672d0 0x7f06d01489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45422/0 (socket says 172.21.15.47:45422) 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 -- 172.21.15.47:0/1727318248 learned_addr learned my addr 172.21.15.47:0/1727318248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 -- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d006c6f0 msgr2=0x7f06d0148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 --2- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d006c6f0 0x7f06d0148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 -- 172.21.15.47:0/1727318248 >> v1:172.21.15.40:6789/0 conn(0x7f06d013ef90 legacy=0x7f06d013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:12.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 -- 172.21.15.47:0/1727318248 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d0073460 con 0x7f06d00672d0 2024-05-12T22:52:12.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d4abf640 1 --2- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d00672d0 0x7f06d01489a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009870 tx=0x7f06c801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610ddfab2778d43a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06cf7fe640 1 -- 172.21.15.47:0/1727318248 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80b2070 con 0x7f06d00672d0 2024-05-12T22:52:12.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06cf7fe640 1 -- 172.21.15.47:0/1727318248 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c80a9070 con 0x7f06d00672d0 2024-05-12T22:52:12.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06cf7fe640 1 -- 172.21.15.47:0/1727318248 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80ad880 con 0x7f06d00672d0 2024-05-12T22:52:12.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d6d23640 1 -- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d00672d0 msgr2=0x7f06d01489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d6d23640 1 --2- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d00672d0 0x7f06d01489a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009870 tx=0x7f06c801c490 comp rx=0 tx=0).stop 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.899+0000 7f06d6d23640 1 -- 172.21.15.47:0/1727318248 shutdown_connections 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 --2- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d006c6f0 0x7f06d0148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 --2- 172.21.15.47:0/1727318248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d00672d0 0x7f06d01489a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/1727318248 >> 172.21.15.47:0/1727318248 conn(0x7f06d006b2c0 msgr2=0x7f06d006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/1727318248 shutdown_connections 2024-05-12T22:52:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/1727318248 wait complete. 2024-05-12T22:52:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 Processor -- start 2024-05-12T22:52:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- start start 2024-05-12T22:52:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00672d0 0x7f06d013e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d0130b50 0x7f06d01e1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06d01527e0 con 0x7f06d00672d0 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0152660 con 0x7f06d013ef90 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f06d0152960 con 0x7f06d0130b50 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d52c0640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d0130b50 0x7f06d01e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45432/0 (socket says 172.21.15.47:45432) 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 -- 172.21.15.47:0/3822023488 learned_addr learned my addr 172.21.15.47:0/3822023488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d4abf640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00672d0 0x7f06d013e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 -- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d0130b50 msgr2=0x7f06d01e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d0130b50 0x7f06d01e1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 -- 172.21.15.47:0/3822023488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00672d0 msgr2=0x7f06d013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00672d0 0x7f06d013e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 -- 172.21.15.47:0/3822023488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d01448e0 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cffff640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e900 tx=0x7f06b800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b8017070 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b800ca00 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d01483e0 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b800cdf0 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d0146750 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06b801a070 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f06b8006610 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.903+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d0068a40 con 0x7f06d013ef90 2024-05-12T22:52:12.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.907+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f06b8006000 con 0x7f06d013ef90 2024-05-12T22:52:12.927 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:12.923+0000 7f101b704180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-12T22:52:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.975+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6", "id": 7} v 0) -- 0x7f06d0146eb0 con 0x7f06d013ef90 2024-05-12T22:52:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.979+0000 7f06cd7fa640 1 -- 172.21.15.47:0/3822023488 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f06b80061e0 con 0x7f06d013ef90 2024-05-12T22:52:12.984 INFO:teuthology.orchestra.run.smithi047.stdout:7 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 msgr2=0x7f06d00b8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e900 tx=0x7f06b800edc0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 shutdown_connections 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06d0130b50 0x7f06d01e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d013ef90 0x7f06d00b8950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 --2- 172.21.15.47:0/3822023488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00672d0 0x7f06d013e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 >> 172.21.15.47:0/3822023488 conn(0x7f06d006b2c0 msgr2=0x7f06d006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 shutdown_connections 2024-05-12T22:52:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-12T22:52:12.983+0000 7f06d6d23640 1 -- 172.21.15.47:0/3822023488 wait complete. 2024-05-12T22:52:13.000 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-12T22:52:13.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-12T22:52:13.003 INFO:tasks.ceph.osd.0:Started 2024-05-12T22:52:13.003 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-12T22:52:13.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-12T22:52:13.006 INFO:tasks.ceph.osd.1:Started 2024-05-12T22:52:13.006 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-12T22:52:13.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-12T22:52:13.008 INFO:tasks.ceph.osd.2:Started 2024-05-12T22:52:13.009 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-12T22:52:13.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-12T22:52:13.011 INFO:tasks.ceph.osd.3:Started 2024-05-12T22:52:13.011 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-12T22:52:13.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-12T22:52:13.013 INFO:tasks.ceph.osd.4:Started 2024-05-12T22:52:13.014 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-12T22:52:13.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-12T22:52:13.016 INFO:tasks.ceph.osd.5:Started 2024-05-12T22:52:13.016 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-12T22:52:13.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-12T22:52:13.018 INFO:tasks.ceph.osd.6:Started 2024-05-12T22:52:13.018 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-12T22:52:13.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-12T22:52:13.020 INFO:tasks.ceph.osd.7:Started 2024-05-12T22:52:13.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:13.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.183+0000 7ff25a85b640 1 Processor -- start 2024-05-12T22:52:13.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.183+0000 7ff25a85b640 1 -- start start 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540b6a20 0x7ff2540b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff254072020 0x7ff2540b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2541411f0 0x7ff254141680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff2540b5ad0 con 0x7ff2540b6a20 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2540b6e00 con 0x7ff2541411f0 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff2540b5730 con 0x7ff254072020 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540b6a20 0x7ff2540b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540b6a20 0x7ff2540b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46782/0 (socket says 172.21.15.40:46782) 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 -- 172.21.15.40:0/1024236161 learned_addr learned my addr 172.21.15.40:0/1024236161 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff258df8640 1 --2- 172.21.15.40:0/1024236161 >> v2:172.21.15.47:3300/0 conn(0x7ff2541411f0 0x7ff254141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff2537fe640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff254072020 0x7ff2540b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 -- 172.21.15.40:0/1024236161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff254072020 msgr2=0x7ff2540b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff254072020 0x7ff2540b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 -- 172.21.15.40:0/1024236161 >> v2:172.21.15.47:3300/0 conn(0x7ff2541411f0 msgr2=0x7ff254141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 --2- 172.21.15.40:0/1024236161 >> v2:172.21.15.47:3300/0 conn(0x7ff2541411f0 0x7ff254141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 -- 172.21.15.40:0/1024236161 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2540b0ed0 con 0x7ff2540b6a20 2024-05-12T22:52:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff253fff640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b6a20 0x7ff2540b4e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff254147490 tx=0x7ff24401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d40f49d51f4c4c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff252ffd640 1 -- 172.21.15.40:0/1024236161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440b1070 con 0x7ff2540b6a20 2024-05-12T22:52:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff252ffd640 1 -- 172.21.15.40:0/1024236161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2440ac630 con 0x7ff2540b6a20 2024-05-12T22:52:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff252ffd640 1 -- 172.21.15.40:0/1024236161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440a8050 con 0x7ff2540b6a20 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- 172.21.15.40:0/1024236161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b6a20 msgr2=0x7ff2540b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b6a20 0x7ff2540b4e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff254147490 tx=0x7ff24401c520 comp rx=0 tx=0).stop 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- 172.21.15.40:0/1024236161 shutdown_connections 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- 172.21.15.40:0/1024236161 >> v2:172.21.15.47:3300/0 conn(0x7ff2541411f0 0x7ff254141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff254072020 0x7ff2540b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 --2- 172.21.15.40:0/1024236161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b6a20 0x7ff2540b4e50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- 172.21.15.40:0/1024236161 >> 172.21.15.40:0/1024236161 conn(0x7ff25406c3d0 msgr2=0x7ff25406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- 172.21.15.40:0/1024236161 shutdown_connections 2024-05-12T22:52:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.187+0000 7ff25a85b640 1 -- 172.21.15.40:0/1024236161 wait complete. 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 Processor -- start 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- start start 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2540b6a20 0x7ff2540af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 0x7ff2540b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff2540709e0 con 0x7ff254072020 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2540b64a0 con 0x7ff2540b6a20 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff254070b60 con 0x7ff2541411f0 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46792/0 (socket says 172.21.15.40:46792) 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 -- 172.21.15.40:0/3210218455 learned_addr learned my addr 172.21.15.40:0/3210218455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff2537fe640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2540b6a20 0x7ff2540af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff258df8640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 0x7ff2540b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 -- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 msgr2=0x7ff2540b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 0x7ff2540b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 -- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2540b6a20 msgr2=0x7ff2540af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2540b6a20 0x7ff2540af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 -- 172.21.15.40:0/3210218455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2540af8c0 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff258df8640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 0x7ff2540b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff253fff640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff24401cdc0 tx=0x7ff2440192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440bc070 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2440ace30 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2540afb40 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440b1070 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff254146f00 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2440bf070 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff2440b7b10 con 0x7ff254072020 2024-05-12T22:52:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.191+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254068a40 con 0x7ff254072020 2024-05-12T22:52:13.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.195+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff2540af8c0 con 0x7ff254072020 2024-05-12T22:52:13.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2540b8820 con 0x7ff254072020 2024-05-12T22:52:13.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff250ff9640 1 -- 172.21.15.40:0/3210218455 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff2440c7090 con 0x7ff254072020 2024-05-12T22:52:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:13.256 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:12.981253+0000","last_up_change":"0.000000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 msgr2=0x7ff2540add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff24401cdc0 tx=0x7ff2440192c0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 shutdown_connections 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2541411f0 0x7ff2540b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2540b6a20 0x7ff2540af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 --2- 172.21.15.40:0/3210218455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff254072020 0x7ff2540add40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:13.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 >> 172.21.15.40:0/3210218455 conn(0x7ff25406c3d0 msgr2=0x7ff2540ba480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:13.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 shutdown_connections 2024-05-12T22:52:13.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:13.251+0000 7ff25a85b640 1 -- 172.21.15.40:0/3210218455 wait complete. 2024-05-12T22:52:13.272 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-12T22:52:13.272 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-12T22:52:13.374 INFO:tasks.ceph.mgr.y.smithi040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-12T22:52:13.374 INFO:tasks.ceph.mgr.y.smithi040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-12T22:52:13.374 INFO:tasks.ceph.mgr.y.smithi040.stderr: from numpy import show_config as show_numpy_config 2024-05-12T22:52:13.399 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-05-12T22:52:13.395+0000 7fed343c07c0 -1 Falling back to public interface 2024-05-12T22:52:13.419 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-05-12T22:52:13.415+0000 7f935f7777c0 -1 Falling back to public interface 2024-05-12T22:52:13.426 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:13.423+0000 7eff3ea13180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T22:52:13.426 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-05-12T22:52:13.423+0000 7fad650f27c0 -1 Falling back to public interface 2024-05-12T22:52:13.569 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:13.563+0000 7eff3ea13180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T22:52:13.602 INFO:tasks.ceph.mgr.x.smithi047.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-12T22:52:13.602 INFO:tasks.ceph.mgr.x.smithi047.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-12T22:52:13.602 INFO:tasks.ceph.mgr.x.smithi047.stderr: from numpy import show_config as show_numpy_config 2024-05-12T22:52:13.618 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-12T22:52:13.615+0000 7f008a9587c0 -1 Falling back to public interface 2024-05-12T22:52:13.633 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-12T22:52:13.631+0000 7ff94550c7c0 -1 Falling back to public interface 2024-05-12T22:52:13.633 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-12T22:52:13.631+0000 7faa2d9027c0 -1 Falling back to public interface 2024-05-12T22:52:13.641 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:13.639+0000 7f101b704180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-12T22:52:13.665 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-12T22:52:13.663+0000 7f84246e77c0 -1 Falling back to public interface 2024-05-12T22:52:13.683 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-05-12T22:52:13.679+0000 7fb7c31477c0 -1 Falling back to public interface 2024-05-12T22:52:13.730 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:13.727+0000 7eff3ea13180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T22:52:13.796 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:13.791+0000 7eff3ea13180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T22:52:13.801 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:13.799+0000 7f101b704180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-12T22:52:13.936 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:13.931+0000 7eff3ea13180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T22:52:13.969 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:13.967+0000 7f101b704180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-12T22:52:14.041 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:14.039+0000 7f101b704180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-12T22:52:14.077 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:14.184 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:14.183+0000 7f101b704180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-12T22:52:14.189 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.183+0000 7f717679e640 1 Processor -- start 2024-05-12T22:52:14.189 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.183+0000 7f717679e640 1 -- start start 2024-05-12T22:52:14.191 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f717679e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f717006fbc0 0x7f717006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f717679e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f717013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f717679e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717006ffa0 con 0x7f717006c810 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f717679e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f71700b52d0 con 0x7f717006fbc0 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f717679e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f71700b55b0 con 0x7f7170149040 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f717006c810 0x7f7170148930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33412/0 (socket says 172.21.15.40:33412) 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716f7fe640 1 -- 172.21.15.40:0/2663860078 learned_addr learned my addr 172.21.15.40:0/2663860078 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f717013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716ffff640 1 --2- 172.21.15.40:0/2663860078 >> v2:172.21.15.47:3300/0 conn(0x7f717006fbc0 0x7f717006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890001059 0 0) 0x7f717006ffa0 con 0x7f717006c810 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7158003530 con 0x7f717006c810 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 53660927 0 0) 0x7f7158003530 con 0x7f717006c810 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 msgr2=0x7f717013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f717013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.192 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 >> v2:172.21.15.47:3300/0 conn(0x7f717006fbc0 msgr2=0x7f717006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 --2- 172.21.15.40:0/2663860078 >> v2:172.21.15.47:3300/0 conn(0x7f717006fbc0 0x7f717006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71700b5890 con 0x7f717006c810 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f7164001680 con 0x7f717006c810 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f717013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 >> v1:172.21.15.40:6789/0 conn(0x7f717006c810 legacy=0x7f7170148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f7158003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7158003fe0 0x7f7158004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7158004d50 0x7f71580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71700b52d0 con 0x7f7158004d50 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71700b55b0 con 0x7f7158003fe0 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f715800bab0 con 0x7f7170149040 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7158004d50 0x7f71580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716f7fe640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7158003fe0 0x7f7158004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 -- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 msgr2=0x7f7158003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:14.193 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7170149040 0x7f7158003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.194 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 -- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7158003fe0 msgr2=0x7f7158004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:14.194 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7158003fe0 0x7f7158004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.194 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 -- 172.21.15.40:0/2663860078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7158003530 con 0x7f7158004d50 2024-05-12T22:52:14.194 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716f7fe640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7158003fe0 0x7f7158004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f7174d3b640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7158004d50 0x7f71580051d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f716800e350 tx=0x7f716801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501116d563a132f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71680b2070 con 0x7f7158004d50 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71680a5e50 con 0x7f7158004d50 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.187+0000 7f716effd640 1 -- 172.21.15.40:0/2663860078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168009de0 con 0x7f7158004d50 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/2663860078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7158004d50 msgr2=0x7f71580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 --2- 172.21.15.40:0/2663860078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7158004d50 0x7f71580051d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f716800e350 tx=0x7f716801ce40 comp rx=0 tx=0).stop 2024-05-12T22:52:14.195 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f7174d3b640 1 -- 172.21.15.40:0/2663860078 reap_dead start 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/2663860078 shutdown_connections 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/2663860078 >> 172.21.15.40:0/2663860078 conn(0x7f71700b9280 msgr2=0x7f71700b9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/2663860078 shutdown_connections 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/2663860078 wait complete. 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 Processor -- start 2024-05-12T22:52:14.196 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- start start 2024-05-12T22:52:14.198 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.198 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71701db3b0 0x7f71701db830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.198 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7170138380 0x7f7170138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:14.198 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f717013f100 con 0x7f71701dafd0 2024-05-12T22:52:14.198 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f717013ef80 con 0x7f7170138380 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f717013f280 con 0x7f71701db3b0 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46812/0 (socket says 172.21.15.40:46812) 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 -- 172.21.15.40:0/971548408 learned_addr learned my addr 172.21.15.40:0/971548408 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716f7fe640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71701db3b0 0x7f71701db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f7174d3b640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7170138380 0x7f7170138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 -- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71701db3b0 msgr2=0x7f71701db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71701db3b0 0x7f71701db830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 -- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7170138380 msgr2=0x7f7170138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:14.199 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7170138380 0x7f7170138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 -- 172.21.15.40:0/971548408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717013fce0 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716ffff640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f716000e7c0 tx=0x7f716000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160017070 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716000c940 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7170140a50 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716000cd30 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71700b9000 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f716001a070 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7160013b40 con 0x7f71701dafd0 2024-05-12T22:52:14.200 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.191+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71700754d0 con 0x7f71701dafd0 2024-05-12T22:52:14.201 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.195+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7160006000 con 0x7f71701dafd0 2024-05-12T22:52:14.257 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.251+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71700b31f0 con 0x7f71701dafd0 2024-05-12T22:52:14.257 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.251+0000 7f716cff9640 1 -- 172.21.15.40:0/971548408 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f71600064d0 con 0x7f71701dafd0 2024-05-12T22:52:14.258 INFO:teuthology.misc.health.smithi040.stdout: 2024-05-12T22:52:14.258 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:12.981253+0000","last_up_change":"0.000000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 msgr2=0x7f71701402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f716000e7c0 tx=0x7f716000ec80 comp rx=0 tx=0).stop 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 shutdown_connections 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7170138380 0x7f7170138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71701db3b0 0x7f71701db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 --2- 172.21.15.40:0/971548408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71701dafd0 0x7f71701402b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 >> 172.21.15.40:0/971548408 conn(0x7f71700b9280 msgr2=0x7f717013c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 shutdown_connections 2024-05-12T22:52:14.259 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:14.255+0000 7f717679e640 1 -- 172.21.15.40:0/971548408 wait complete. 2024-05-12T22:52:14.273 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-12T22:52:14.592 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:14.587+0000 7eff3ea13180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T22:52:14.671 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:14.667+0000 7eff3ea13180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T22:52:14.834 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:14.831+0000 7f101b704180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-12T22:52:14.861 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:14.855+0000 7eff3ea13180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T22:52:14.913 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:14.911+0000 7f101b704180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-12T22:52:14.939 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:14.935+0000 7eff3ea13180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T22:52:15.104 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:15.103+0000 7f101b704180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-12T22:52:15.182 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:15.179+0000 7f101b704180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-12T22:52:15.243 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:15.239+0000 7eff3ea13180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T22:52:15.308 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:15.303+0000 7eff3ea13180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T22:52:15.495 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:15.491+0000 7f101b704180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-12T22:52:15.561 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-12T22:52:15.559+0000 7f101b704180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-12T22:52:16.351 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-05-12T22:52:16.347+0000 7efee5e59640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-12T22:52:17.202 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-05-12T22:52:17.199+0000 7f935f7777c0 -1 osd.0 0 log_to_monitors true 2024-05-12T22:52:17.259 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-05-12T22:52:17.255+0000 7fad650f27c0 -1 osd.1 0 log_to_monitors true 2024-05-12T22:52:17.276 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-05-12T22:52:17.271+0000 7fed343c07c0 -1 osd.2 0 log_to_monitors true 2024-05-12T22:52:17.390 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-12T22:52:17.387+0000 7f008a9587c0 -1 osd.6 0 log_to_monitors true 2024-05-12T22:52:17.470 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-12T22:52:17.467+0000 7faa2d9027c0 -1 osd.4 0 log_to_monitors true 2024-05-12T22:52:17.538 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-12T22:52:17.535+0000 7ff94550c7c0 -1 osd.5 0 log_to_monitors true 2024-05-12T22:52:17.543 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-12T22:52:17.539+0000 7f84246e77c0 -1 osd.7 0 log_to_monitors true 2024-05-12T22:52:17.604 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-05-12T22:52:17.599+0000 7fb7c31477c0 -1 osd.3 0 log_to_monitors true 2024-05-12T22:52:19.377 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-05-12T22:52:19.371+0000 7fad6109b640 -1 osd.1 0 waiting for initial osdmap 2024-05-12T22:52:19.397 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-05-12T22:52:19.391+0000 7f935b720640 -1 osd.0 0 waiting for initial osdmap 2024-05-12T22:52:19.407 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-05-12T22:52:19.403+0000 7fed30369640 -1 osd.2 0 waiting for initial osdmap 2024-05-12T22:52:19.414 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-05-12T22:52:19.411+0000 7fad58ed0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:19.430 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-05-12T22:52:19.427+0000 7f9353555640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:19.434 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-05-12T22:52:19.431+0000 7fed2819e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:19.985 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-05-12T22:52:19.979+0000 7fb7bf0f0640 -1 osd.3 0 waiting for initial osdmap 2024-05-12T22:52:20.011 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-05-12T22:52:20.011+0000 7fb7b6f25640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:20.462 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-12T22:52:20.459+0000 7faa2a0bd640 -1 osd.4 0 waiting for initial osdmap 2024-05-12T22:52:20.493 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-12T22:52:20.491+0000 7faa216e0640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:20.519 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-12T22:52:20.515+0000 7ff941cc7640 -1 osd.5 0 waiting for initial osdmap 2024-05-12T22:52:20.545 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-12T22:52:20.543+0000 7ff9392ea640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:20.571 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-12T22:52:20.567+0000 7f8420ea2640 -1 osd.7 0 waiting for initial osdmap 2024-05-12T22:52:20.597 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-12T22:52:20.595+0000 7f84184c5640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:20.615 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-12T22:52:20.611+0000 7f0086901640 -1 osd.6 0 waiting for initial osdmap 2024-05-12T22:52:20.637 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-12T22:52:20.635+0000 7f007e736640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-12T22:52:21.079 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:21.206 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 Processor -- start 2024-05-12T22:52:21.207 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 -- start start 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f234806c530 0x7f2348072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23480b5580 0x7f2348141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23480b0080 con 0x7f23480b59e0 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f23480ae340 con 0x7f23480b5580 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f234d538640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f234806c910 con 0x7f234806c530 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23480b5580 0x7f2348141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.208 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23480b5580 0x7f2348141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56646/0 (socket says 172.21.15.40:56646) 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 -- 172.21.15.40:0/3156439478 learned_addr learned my addr 172.21.15.40:0/3156439478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23477fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23480b59e0 0x7f2348147860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55846/0 (socket says 172.21.15.40:55846) 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 -- 172.21.15.40:0/3156439478 >> v2:172.21.15.47:3300/0 conn(0x7f234806c530 msgr2=0x7f2348072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f2346ffd640 1 --2- 172.21.15.40:0/3156439478 >> v2:172.21.15.47:3300/0 conn(0x7f234806c530 0x7f2348072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f2345ffb640 1 -- 172.21.15.40:0/3156439478 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896823383 0 0) 0x7f23480b0080 con 0x7f23480b59e0 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 --2- 172.21.15.40:0/3156439478 >> v2:172.21.15.47:3300/0 conn(0x7f234806c530 0x7f2348072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 -- 172.21.15.40:0/3156439478 >> v1:172.21.15.40:6789/0 conn(0x7f23480b59e0 legacy=0x7f2348147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.209 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.203+0000 7f23467fc640 1 -- 172.21.15.40:0/3156439478 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23480ae5e0 con 0x7f23480b5580 2024-05-12T22:52:21.210 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f23467fc640 1 --2- 172.21.15.40:0/3156439478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23480b5580 0x7f2348141660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23480742e0 tx=0x7f233c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed77eaa481bfc6c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:21.210 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2345ffb640 1 -- 172.21.15.40:0/3156439478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b0070 con 0x7f23480b5580 2024-05-12T22:52:21.210 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2345ffb640 1 -- 172.21.15.40:0/3156439478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233c0ab600 con 0x7f23480b5580 2024-05-12T22:52:21.210 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2345ffb640 1 -- 172.21.15.40:0/3156439478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c0ab9d0 con 0x7f23480b5580 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- 172.21.15.40:0/3156439478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23480b5580 msgr2=0x7f2348141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- 172.21.15.40:0/3156439478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23480b5580 0x7f2348141660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23480742e0 tx=0x7f233c01c400 comp rx=0 tx=0).stop 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- 172.21.15.40:0/3156439478 shutdown_connections 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- 172.21.15.40:0/3156439478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23480b5580 0x7f2348141660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- 172.21.15.40:0/3156439478 >> v2:172.21.15.47:3300/0 conn(0x7f234806c530 0x7f2348072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- 172.21.15.40:0/3156439478 >> 172.21.15.40:0/3156439478 conn(0x7f23480b5e70 msgr2=0x7f23480b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:21.211 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- 172.21.15.40:0/3156439478 shutdown_connections 2024-05-12T22:52:21.212 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- 172.21.15.40:0/3156439478 wait complete. 2024-05-12T22:52:21.212 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 Processor -- start 2024-05-12T22:52:21.212 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- start start 2024-05-12T22:52:21.214 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.214 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23480b5580 0x7f23481e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.214 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 0x7f23481e0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.214 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23480aee00 con 0x7f234806c530 2024-05-12T22:52:21.214 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23480736e0 con 0x7f23480b59e0 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f234d538640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f23480aef80 con 0x7f23480b5580 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56648/0 (socket says 172.21.15.40:56648) 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 -- 172.21.15.40:0/3165552472 learned_addr learned my addr 172.21.15.40:0/3165552472 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f23477fe640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 0x7f23481e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f23467fc640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23480b5580 0x7f23481e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 -- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23480b5580 msgr2=0x7f23481e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23480b5580 0x7f23481e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 -- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 msgr2=0x7f23481e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.207+0000 7f2346ffd640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 0x7f23481e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f2346ffd640 1 -- 172.21.15.40:0/3165552472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2348138fc0 con 0x7f234806c530 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f23477fe640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 0x7f23481e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f2346ffd640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f233800c820 tx=0x7f233800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338015070 con 0x7f234806c530 2024-05-12T22:52:21.215 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2338004240 con 0x7f234806c530 2024-05-12T22:52:21.216 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2348070610 con 0x7f234806c530 2024-05-12T22:52:21.216 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233800ce10 con 0x7f234806c530 2024-05-12T22:52:21.216 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2348070bd0 con 0x7f234806c530 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2348074860 con 0x7f234806c530 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f2338007830 con 0x7f234806c530 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 0x7f2334069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f23467fc640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 0x7f2334069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3351+0+0 (secure 0 0 0) 0x7f2338085090 con 0x7f234806c530 2024-05-12T22:52:21.217 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.211+0000 7f23467fc640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 0x7f2334069d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f233c0ad000 tx=0x7f233c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:21.221 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.215+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f23380565e0 con 0x7f234806c530 2024-05-12T22:52:21.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.383+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2348138ce0 con 0x7f234806c530 2024-05-12T22:52:21.425 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.419+0000 7f232f7fe640 1 -- 172.21.15.40:0/3165552472 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8953 (secure 0 0 0) 0x7f2338055ee0 con 0x7f234806c530 2024-05-12T22:52:21.426 INFO:teuthology.misc.health.smithi040.stdout: 2024-05-12T22:52:21.426 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":14,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:20.411996+0000","last_up_change":"2024-05-12T22:52:20.411996+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:21.428 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 msgr2=0x7f2334069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.428 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 0x7f2334069d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f233c0ad000 tx=0x7f233c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:21.428 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 msgr2=0x7f2348071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:21.428 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f233800c820 tx=0x7f233800cce0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 shutdown_connections 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2334067860 0x7f2334069d20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23480b59e0 0x7f23481e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23480b5580 0x7f23481e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 --2- 172.21.15.40:0/3165552472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f234806c530 0x7f2348071e80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 >> 172.21.15.40:0/3165552472 conn(0x7f23480b5e70 msgr2=0x7f2348146b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 shutdown_connections 2024-05-12T22:52:21.429 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:21.423+0000 7f234d538640 1 -- 172.21.15.40:0/3165552472 wait complete. 2024-05-12T22:52:21.445 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-05-12T22:52:28.256 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:28.382 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 Processor -- start 2024-05-12T22:52:28.382 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 -- start start 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b8c14b260 0x7f2b8c1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b8c0b1d00 0x7f2b8c141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8c0b7dd0 con 0x7f2b8c0b79f0 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8c06de40 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b9163c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8c06d7f0 con 0x7f2b8c14b260 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b8c0b79f0 0x7f2b8c14ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55850/0 (socket says 172.21.15.40:55850) 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8affd640 1 -- 172.21.15.40:0/3814599365 learned_addr learned my addr 172.21.15.40:0/3814599365 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/3814599365 >> v2:172.21.15.40:3300/0 conn(0x7f2b8c0b1d00 0x7f2b8c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8a7fc640 1 --2- 172.21.15.40:0/3814599365 >> v2:172.21.15.47:3300/0 conn(0x7f2b8c14b260 0x7f2b8c1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b89ffb640 1 -- 172.21.15.40:0/3814599365 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244178176 0 0) 0x7f2b8c0b7dd0 con 0x7f2b8c0b79f0 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b89ffb640 1 -- 172.21.15.40:0/3814599365 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b74003530 con 0x7f2b8c0b79f0 2024-05-12T22:52:28.384 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/3814599365 >> v2:172.21.15.47:3300/0 conn(0x7f2b8c14b260 msgr2=0x7f2b8c1413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:28.385 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/3814599365 >> v2:172.21.15.47:3300/0 conn(0x7f2b8c14b260 0x7f2b8c1413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.385 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/3814599365 >> v1:172.21.15.40:6789/0 conn(0x7f2b8c0b79f0 legacy=0x7f2b8c14ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.385 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.383+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/3814599365 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c06dad0 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.387 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/3814599365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c141910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0b7760 tx=0x7f2b8401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cb73701ce56e46 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.387 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b89ffb640 1 -- 172.21.15.40:0/3814599365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b840b2070 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.387 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b89ffb640 1 -- 172.21.15.40:0/3814599365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b840a5900 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.387 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b89ffb640 1 -- 172.21.15.40:0/3814599365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b840a5cb0 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.387 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- 172.21.15.40:0/3814599365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c0b1d00 msgr2=0x7f2b8c141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- 172.21.15.40:0/3814599365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c141910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0b7760 tx=0x7f2b8401c930 comp rx=0 tx=0).stop 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- 172.21.15.40:0/3814599365 shutdown_connections 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- 172.21.15.40:0/3814599365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c141910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- 172.21.15.40:0/3814599365 >> v2:172.21.15.47:3300/0 conn(0x7f2b8c14b260 0x7f2b8c1413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- 172.21.15.40:0/3814599365 >> 172.21.15.40:0/3814599365 conn(0x7f2b8c06b2c0 msgr2=0x7f2b8c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- 172.21.15.40:0/3814599365 shutdown_connections 2024-05-12T22:52:28.388 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- 172.21.15.40:0/3814599365 wait complete. 2024-05-12T22:52:28.391 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 Processor -- start 2024-05-12T22:52:28.391 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- start start 2024-05-12T22:52:28.391 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.391 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b8c0b79f0 0x7f2b8c147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c154a90 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c154910 con 0x7f2b8c0b1d00 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b9163c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8c154c10 con 0x7f2b8c0b79f0 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56692/0 (socket says 172.21.15.40:56692) 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/2509399700 learned_addr learned my addr 172.21.15.40:0/2509399700 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8affd640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.392 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8a7fc640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b8c0b79f0 0x7f2b8c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b8c0b79f0 msgr2=0x7f2b8c147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b8c0b79f0 0x7f2b8c147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b8c0b1d00 msgr2=0x7f2b8c146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 -- 172.21.15.40:0/2509399700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c0b2560 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b8b7fe640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b840b0040 tx=0x7f2b840196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b840b2050 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.387+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b840be070 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c1e0430 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84009450 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.393 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c151c70 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.394 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8c0754d0 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.394 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b840adcc0 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.394 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b737fe640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 0x7f2b78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.395 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b84120c40 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.395 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b8affd640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 0x7f2b78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.395 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.391+0000 7f2b8affd640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 0x7f2b78069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c007fd0 tx=0x7f2b7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.411 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.411+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2b84016520 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.575 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.575+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b8c0b7540 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.577 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.575+0000 7f2b737fe640 1 -- 172.21.15.40:0/2509399700 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12812 (secure 0 0 0) 0x7f2b840f1ac0 con 0x7f2b8c1e32f0 2024-05-12T22:52:28.577 INFO:teuthology.misc.health.smithi040.stdout: 2024-05-12T22:52:28.577 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":17,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:23.473645+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 msgr2=0x7f2b78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 0x7f2b78069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c007fd0 tx=0x7f2b7c009040 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 msgr2=0x7f2b8c1e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b840b0040 tx=0x7f2b840196d0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 shutdown_connections 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c1e32f0 0x7f2b8c1e3770 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b8c0b79f0 0x7f2b8c147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b780678c0 0x7f2b78069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 --2- 172.21.15.40:0/2509399700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b8c0b1d00 0x7f2b8c146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 >> 172.21.15.40:0/2509399700 conn(0x7f2b8c06b2c0 msgr2=0x7f2b8c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:28.580 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 shutdown_connections 2024-05-12T22:52:28.581 INFO:teuthology.misc.health.smithi040.stderr:2024-05-12T22:52:28.579+0000 7f2b9163c640 1 -- 172.21.15.40:0/2509399700 wait complete. 2024-05-12T22:52:28.596 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-12T22:52:28.596 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-12T22:52:28.596 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-12T22:52:28.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-12T22:52:28.599 INFO:tasks.ceph.mds.a:Started 2024-05-12T22:52:28.599 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-12T22:52:28.599 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-12T22:52:28.601 INFO:tasks.ceph.mds.b:Started 2024-05-12T22:52:28.602 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-12T22:52:28.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:28.696 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-12T22:52:28.702 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-05-12T22:52:28.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 Processor -- start 2024-05-12T22:52:28.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 -- start start 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa78c0b6260 0x7fa78c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c06da20 con 0x7fa78c0b4e90 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0b5a60 con 0x7fa78c06d640 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa79314d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0b0e40 con 0x7fa78c0b6260 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa78bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa78c0b6260 0x7fa78c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa7916ea640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa78c0b4e90 0x7fa78c141390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55852/0 (socket says 172.21.15.40:55852) 2024-05-12T22:52:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa7916ea640 1 -- 172.21.15.40:0/3474343494 learned_addr learned my addr 172.21.15.40:0/3474343494 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa78bfff640 1 -- 172.21.15.40:0/3474343494 >> v1:172.21.15.47:6789/0 conn(0x7fa78c06d640 legacy=0x7fa78c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa78bfff640 1 -- 172.21.15.40:0/3474343494 >> v1:172.21.15.40:6789/0 conn(0x7fa78c0b4e90 legacy=0x7fa78c141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa78b7fe640 1 -- 172.21.15.40:0/3474343494 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940175936 0 0) 0x7fa78c06da20 con 0x7fa78c0b4e90 2024-05-12T22:52:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.719+0000 7fa78bfff640 1 -- 172.21.15.40:0/3474343494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0b5d40 con 0x7fa78c0b6260 2024-05-12T22:52:28.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa78bfff640 1 --2- 172.21.15.40:0/3474343494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c070450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa7740097c0 tx=0x7fa77401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b652936afee85 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa78b7fe640 1 -- 172.21.15.40:0/3474343494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740b1070 con 0x7fa78c0b6260 2024-05-12T22:52:28.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa78b7fe640 1 -- 172.21.15.40:0/3474343494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7740ac600 con 0x7fa78c0b6260 2024-05-12T22:52:28.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa78b7fe640 1 -- 172.21.15.40:0/3474343494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740ac9d0 con 0x7fa78c0b6260 2024-05-12T22:52:28.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- 172.21.15.40:0/3474343494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 msgr2=0x7fa78c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 --2- 172.21.15.40:0/3474343494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c070450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa7740097c0 tx=0x7fa77401c340 comp rx=0 tx=0).stop 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- 172.21.15.40:0/3474343494 shutdown_connections 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 --2- 172.21.15.40:0/3474343494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c070450 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- 172.21.15.40:0/3474343494 >> 172.21.15.40:0/3474343494 conn(0x7fa78c0b6720 msgr2=0x7fa78c0b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- 172.21.15.40:0/3474343494 shutdown_connections 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- 172.21.15.40:0/3474343494 wait complete. 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 Processor -- start 2024-05-12T22:52:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.723+0000 7fa79314d640 1 -- start start 2024-05-12T22:52:28.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 0x7fa78c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 0x7fa78c142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c1558c0 con 0x7fa78c0b6260 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c155740 con 0x7fa78c06d640 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c155a40 con 0x7fa78c0b4e90 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56718/0 (socket says 172.21.15.40:56718) 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 -- 172.21.15.40:0/1700057914 learned_addr learned my addr 172.21.15.40:0/1700057914 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa790ee9640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 0x7fa78c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa78bfff640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 0x7fa78c142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 -- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 msgr2=0x7fa78c142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 0x7fa78c142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 -- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 msgr2=0x7fa78c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 0x7fa78c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 -- 172.21.15.40:0/1700057914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c1443a0 con 0x7fa78c0b6260 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa790ee9640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 0x7fa78c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa78bfff640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 0x7fa78c142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7916ea640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c7d0 tx=0x7fa77c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c018070 con 0x7fa78c0b6260 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c00a640 con 0x7fa78c0b6260 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00aa70 con 0x7fa78c0b6260 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c147420 con 0x7fa78c0b6260 2024-05-12T22:52:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c143e90 con 0x7fa78c0b6260 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c068a40 con 0x7fa78c0b6260 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa77c00ac10 con 0x7fa78c0b6260 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 0x7fa76c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa790ee9640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 0x7fa76c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.727+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa77c084f90 con 0x7fa78c0b6260 2024-05-12T22:52:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.731+0000 7fa790ee9640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 0x7fa76c069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa784000f70 tx=0x7fa784009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.735+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa78c1443a0 con 0x7fa78c0b6260 2024-05-12T22:52:28.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.899+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa78c0730b0 con 0x7fa78c0b6260 2024-05-12T22:52:28.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.899+0000 7fa7897fa640 1 -- 172.21.15.40:0/1700057914 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12812 (secure 0 0 0) 0x7fa77c055d90 con 0x7fa78c0b6260 2024-05-12T22:52:28.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:23.473645+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:28.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 msgr2=0x7fa76c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 0x7fa76c069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa784000f70 tx=0x7fa784009040 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 msgr2=0x7fa78c142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c7d0 tx=0x7fa77c00cc90 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 shutdown_connections 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa78c0b6260 0x7fa78c142f90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa78c0b4e90 0x7fa78c142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa76c0678c0 0x7fa76c069d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 --2- 172.21.15.40:0/1700057914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78c06d640 0x7fa78c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 >> 172.21.15.40:0/1700057914 conn(0x7fa78c0b6720 msgr2=0x7fa78c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 shutdown_connections 2024-05-12T22:52:28.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:28.903+0000 7fa79314d640 1 -- 172.21.15.40:0/1700057914 wait complete. 2024-05-12T22:52:28.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:52:28.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 Processor -- start 2024-05-12T22:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 -- start start 2024-05-12T22:52:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39fc14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0b2250 con 0x7f39fc0b5d70 2024-05-12T22:52:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0b1110 con 0x7f39fc1541c0 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f3a01895640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc14c7e0 con 0x7f39fc14be20 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39faffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f39fc0b5d70 0x7f39fc0b4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55856/0 (socket says 172.21.15.40:55856) 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39faffd640 1 -- 172.21.15.40:0/3293858892 learned_addr learned my addr 172.21.15.40:0/3293858892 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938818998 0 0) 0x7f39fc0b2250 con 0x7f39fc0b5d70 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e4003530 con 0x7f39fc0b5d70 2024-05-12T22:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fa7fc640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39fc14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3887795911 0 0) 0x7f39e4003530 con 0x7f39fc0b5d70 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 msgr2=0x7f39fc14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39fc14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 >> v1:172.21.15.47:6789/0 conn(0x7f39fc1541c0 legacy=0x7f39fc1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc0b6150 con 0x7f39fc0b5d70 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f39ec001680 con 0x7f39fc0b5d70 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 >> v1:172.21.15.40:6789/0 conn(0x7f39fc0b5d70 legacy=0x7f39fc0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40039f0 0x7f39e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e4004d50 0x7f39e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc14c7e0 con 0x7f39e4004d50 2024-05-12T22:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39e400ba80 con 0x7f39e40039f0 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f39e400bc80 con 0x7f39fc14be20 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e4004d50 0x7f39e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fa7fc640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39faffd640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40039f0 0x7f39e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 -- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 msgr2=0x7f39e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14be20 0x7f39e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 -- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40039f0 msgr2=0x7f39e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40039f0 0x7f39e4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39fb7fe640 1 -- 172.21.15.40:0/3293858892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e4003530 con 0x7f39e4004d50 2024-05-12T22:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.047+0000 7f39faffd640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40039f0 0x7f39e4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f39fb7fe640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e4004d50 0x7f39e40051d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001e40 tx=0x7f39f401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be0e131823ec13d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4001a90 con 0x7f39e4004d50 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4003b80 con 0x7f39e4004d50 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f39f9ffb640 1 -- 172.21.15.40:0/3293858892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005080 con 0x7f39e4004d50 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- 172.21.15.40:0/3293858892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e4004d50 msgr2=0x7f39e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 --2- 172.21.15.40:0/3293858892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e4004d50 0x7f39e40051d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39f4001e40 tx=0x7f39f401c760 comp rx=0 tx=0).stop 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f39fb7fe640 1 -- 172.21.15.40:0/3293858892 reap_dead start 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- 172.21.15.40:0/3293858892 shutdown_connections 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- 172.21.15.40:0/3293858892 >> 172.21.15.40:0/3293858892 conn(0x7f39fc06b6c0 msgr2=0x7f39fc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- 172.21.15.40:0/3293858892 shutdown_connections 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- 172.21.15.40:0/3293858892 wait complete. 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 Processor -- start 2024-05-12T22:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 -- start start 2024-05-12T22:52:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.051+0000 7f3a01895640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39fc14dea0 0x7f39fc14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14e280 0x7f39fc1e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b24c0 con 0x7f39fc1503a0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b13b0 con 0x7f39fc14dea0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0afd30 con 0x7f39fc14e280 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56742/0 (socket says 172.21.15.40:56742) 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 -- 172.21.15.40:0/2239775228 learned_addr learned my addr 172.21.15.40:0/2239775228 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fb7fe640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14e280 0x7f39fc1e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39faffd640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39fc14dea0 0x7f39fc14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 -- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14e280 msgr2=0x7f39fc1e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14e280 0x7f39fc1e4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 -- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39fc14dea0 msgr2=0x7f39fc14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39fc14dea0 0x7f39fc14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 -- 172.21.15.40:0/2239775228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc14e780 con 0x7f39fc1503a0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39fa7fc640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39f0011a00 tx=0x7f39f0011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f000fb50 con 0x7f39fc1503a0 2024-05-12T22:52:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f000fcf0 con 0x7f39fc1503a0 2024-05-12T22:52:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f000fea0 con 0x7f39fc1503a0 2024-05-12T22:52:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc150840 con 0x7f39fc1503a0 2024-05-12T22:52:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc0af5b0 con 0x7f39fc1503a0 2024-05-12T22:52:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc068330 con 0x7f39fc1503a0 2024-05-12T22:52:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39f0012040 con 0x7f39fc1503a0 2024-05-12T22:52:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 0x7f39e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f39f00860a0 con 0x7f39fc1503a0 2024-05-12T22:52:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39faffd640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 0x7f39e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.055+0000 7f39faffd640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 0x7f39e8069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000fe0 tx=0x7f39ec001c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.059+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f39f0019030 con 0x7f39fc1503a0 2024-05-12T22:52:29.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.219+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39fc149860 con 0x7f39fc1503a0 2024-05-12T22:52:29.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.219+0000 7f39e3fff640 1 -- 172.21.15.40:0/2239775228 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f39f0056f50 con 0x7f39fc1503a0 2024-05-12T22:52:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:52:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 msgr2=0x7f39e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 0x7f39e8069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000fe0 tx=0x7f39ec001c50 comp rx=0 tx=0).stop 2024-05-12T22:52:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 msgr2=0x7f39fc1e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39f0011a00 tx=0x7f39f0011ec0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 shutdown_connections 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc14e280 0x7f39fc1e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc1503a0 0x7f39fc1e4540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e80678c0 0x7f39e8069d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 --2- 172.21.15.40:0/2239775228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39fc14dea0 0x7f39fc14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 >> 172.21.15.40:0/2239775228 conn(0x7f39fc06b6c0 msgr2=0x7f39fc0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 shutdown_connections 2024-05-12T22:52:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.223+0000 7f3a01895640 1 -- 172.21.15.40:0/2239775228 wait complete. 2024-05-12T22:52:29.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:29.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.359+0000 7f18240b9640 1 Processor -- start 2024-05-12T22:52:29.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.359+0000 7f18240b9640 1 -- start start 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 0x7f181c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 0x7f181c13f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f181c1460b0 0x7f181c13f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f181c071530 con 0x7f181c1460b0 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f181c145390 con 0x7f181c0b57b0 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f181c0b7e80 con 0x7f181c0b7730 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f181c1460b0 0x7f181c13f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f181c1460b0 0x7f181c13f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56754/0 (socket says 172.21.15.40:56754) 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 -- 172.21.15.40:0/4185273266 learned_addr learned my addr 172.21.15.40:0/4185273266 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1821654640 1 --2- 172.21.15.40:0/4185273266 >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 0x7f181c13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1821e55640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 0x7f181c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 -- 172.21.15.40:0/4185273266 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 msgr2=0x7f181c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 0x7f181c145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 -- 172.21.15.40:0/4185273266 >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 msgr2=0x7f181c13f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 --2- 172.21.15.40:0/4185273266 >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 0x7f181c13f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 -- 172.21.15.40:0/4185273266 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c0b5c40 con 0x7f181c1460b0 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1821654640 1 --2- 172.21.15.40:0/4185273266 >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 0x7f181c13f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1821e55640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 0x7f181c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:29.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1822656640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c1460b0 0x7f181c13f780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f181c0b8230 tx=0x7f181401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955e67c07c63e3e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1820e53640 1 -- 172.21.15.40:0/4185273266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140a5550 con 0x7f181c1460b0 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1820e53640 1 -- 172.21.15.40:0/4185273266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140a56f0 con 0x7f181c1460b0 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f1820e53640 1 -- 172.21.15.40:0/4185273266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140a5ac0 con 0x7f181c1460b0 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- 172.21.15.40:0/4185273266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c1460b0 msgr2=0x7f181c13f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c1460b0 0x7f181c13f780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f181c0b8230 tx=0x7f181401c8d0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- 172.21.15.40:0/4185273266 shutdown_connections 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c1460b0 0x7f181c13f780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- 172.21.15.40:0/4185273266 >> v2:172.21.15.47:3300/0 conn(0x7f181c0b57b0 0x7f181c13f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 --2- 172.21.15.40:0/4185273266 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c0b7730 0x7f181c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- 172.21.15.40:0/4185273266 >> 172.21.15.40:0/4185273266 conn(0x7f181c06e5e0 msgr2=0x7f181c06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- 172.21.15.40:0/4185273266 shutdown_connections 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.363+0000 7f18240b9640 1 -- 172.21.15.40:0/4185273266 wait complete. 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 Processor -- start 2024-05-12T22:52:29.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- start start 2024-05-12T22:52:29.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f181c0b7730 0x7f181c13bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 0x7f181c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f181c1494a0 con 0x7f181c06d770 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f181c149320 con 0x7f181c0b7730 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f181c149620 con 0x7f181c1460b0 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56764/0 (socket says 172.21.15.40:56764) 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 -- 172.21.15.40:0/3356356178 learned_addr learned my addr 172.21.15.40:0/3356356178 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1821e55640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f181c0b7730 0x7f181c13bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1821654640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 0x7f181c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 -- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 msgr2=0x7f181c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 0x7f181c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 -- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f181c0b7730 msgr2=0x7f181c13bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f181c0b7730 0x7f181c13bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 -- 172.21.15.40:0/3356356178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c1464f0 con 0x7f181c06d770 2024-05-12T22:52:29.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1821654640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 0x7f181c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f1822656640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f181401d170 tx=0x7f1814019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140bc020 con 0x7f181c06d770 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140b8670 con 0x7f181c06d770 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140b8a60 con 0x7f181c06d770 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c13c8f0 con 0x7f181c06d770 2024-05-12T22:52:29.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c146a70 con 0x7f181c06d770 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c068a40 con 0x7f181c06d770 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.367+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18140bf020 con 0x7f181c06d770 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.371+0000 7f18127fc640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 0x7f1800069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.371+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1814120900 con 0x7f181c06d770 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.371+0000 7f1821e55640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 0x7f1800069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.371+0000 7f1821e55640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 0x7f1800069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1818006fd0 tx=0x7f1818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.375+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f18140c6030 con 0x7f181c06d770 2024-05-12T22:52:29.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f181c13cd40 con 0x7f181c06d770 2024-05-12T22:52:29.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18127fc640 1 -- 172.21.15.40:0/3356356178 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f18140165e0 con 0x7f181c06d770 2024-05-12T22:52:29.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-12T22:52:29.579 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-05-12T22:52:29.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 msgr2=0x7f1800069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 0x7f1800069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1818006fd0 tx=0x7f1818008040 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 msgr2=0x7f181c138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f181401d170 tx=0x7f1814019670 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 shutdown_connections 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181c06d770 0x7f181c138f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f181c1460b0 0x7f181c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f18000678c0 0x7f1800069d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 --2- 172.21.15.40:0/3356356178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f181c0b7730 0x7f181c13bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.579+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 >> 172.21.15.40:0/3356356178 conn(0x7f181c06e5e0 msgr2=0x7f181c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.583+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 shutdown_connections 2024-05-12T22:52:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:29.583+0000 7f18240b9640 1 -- 172.21.15.40:0/3356356178 wait complete. 2024-05-12T22:52:31.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 Processor -- start 2024-05-12T22:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 -- start start 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7b40b5860 0x7fd7b40b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b40b5c40 con 0x7fd7b414ab00 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40ba500 con 0x7fd7b40b5860 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7bc4e6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40b43d0 con 0x7fd7b414af90 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7baa83640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7ba282640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7b40b5860 0x7fd7b40b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7baa83640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:36474/0 (socket says 172.21.15.40:36474) 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7baa83640 1 -- 172.21.15.40:0/4134556785 learned_addr learned my addr 172.21.15.40:0/4134556785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7ba282640 1 -- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 msgr2=0x7fd7b4151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7ba282640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7ba282640 1 -- 172.21.15.40:0/4134556785 >> v1:172.21.15.47:6789/0 conn(0x7fd7b414ab00 legacy=0x7fd7b41413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7ba282640 1 -- 172.21.15.40:0/4134556785 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40b46b0 con 0x7fd7b40b5860 2024-05-12T22:52:31.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.735+0000 7fd7baa83640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:31.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40b5860 0x7fd7b40b9ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009d90 tx=0x7fd7b001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace44677ca0e4393 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:31.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7b9280640 1 -- 172.21.15.40:0/4134556785 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00b2070 con 0x7fd7b40b5860 2024-05-12T22:52:31.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7b9280640 1 -- 172.21.15.40:0/4134556785 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b00a5830 con 0x7fd7b40b5860 2024-05-12T22:52:31.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7b9280640 1 -- 172.21.15.40:0/4134556785 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00a5c00 con 0x7fd7b40b5860 2024-05-12T22:52:31.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40b5860 msgr2=0x7fd7b40b9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40b5860 0x7fd7b40b9ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009d90 tx=0x7fd7b001c970 comp rx=0 tx=0).stop 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/4134556785 shutdown_connections 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414af90 0x7fd7b4151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/4134556785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b40b5860 0x7fd7b40b9ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/4134556785 >> 172.21.15.40:0/4134556785 conn(0x7fd7b4072df0 msgr2=0x7fd7b4073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/4134556785 shutdown_connections 2024-05-12T22:52:31.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/4134556785 wait complete. 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 Processor -- start 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- start start 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 0x7fd7b414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 0x7fd7b4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4154bf0 con 0x7fd7b40b5860 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b40b8b60 con 0x7fd7b414af90 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7bc4e6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b4154d70 con 0x7fd7b414ab00 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59120/0 (socket says 172.21.15.40:59120) 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 -- 172.21.15.40:0/803907218 learned_addr learned my addr 172.21.15.40:0/803907218 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7baa83640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 0x7fd7b4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7b9a81640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 0x7fd7b414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 -- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 msgr2=0x7fd7b414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 0x7fd7b414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 -- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 msgr2=0x7fd7b4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 0x7fd7b4151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.739+0000 7fd7ba282640 1 -- 172.21.15.40:0/803907218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40b96e0 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7baa83640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 0x7fd7b4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7b9a81640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 0x7fd7b414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7ba282640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009d90 tx=0x7fd7b0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00b2050 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b00be070 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b414ea90 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00ada50 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b41e06d0 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b4068a40 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7b00a56b0 con 0x7fd7b40b5860 2024-05-12T22:52:31.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:31.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd7b0120a60 con 0x7fd7b40b5860 2024-05-12T22:52:31.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7b9a81640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:31.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.743+0000 7fd7b9a81640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 0x7fd798069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4144700 tx=0x7fd7a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:31.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.747+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd7b0016560 con 0x7fd7b40b5860 2024-05-12T22:52:31.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:52:31.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:52:31.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.947+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7b4148d60 con 0x7fd7b40b5860 2024-05-12T22:52:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.947+0000 7fd7aaffd640 1 -- 172.21.15.40:0/803907218 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7fd7b00ab340 con 0x7fd7b40b5860 2024-05-12T22:52:31.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-12T22:52:31.949 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 msgr2=0x7fd798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 0x7fd798069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4144700 tx=0x7fd7a4009040 comp rx=0 tx=0).stop 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 msgr2=0x7fd7b41e3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009d90 tx=0x7fd7b0019710 comp rx=0 tx=0).stop 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 shutdown_connections 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b414af90 0x7fd7b4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7b414ab00 0x7fd7b414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 --2- 172.21.15.40:0/803907218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7b40b5860 0x7fd7b41e3400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 >> 172.21.15.40:0/803907218 conn(0x7fd7b4072df0 msgr2=0x7fd7b4149280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 shutdown_connections 2024-05-12T22:52:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:31.951+0000 7fd7bc4e6640 1 -- 172.21.15.40:0/803907218 wait complete. 2024-05-12T22:52:31.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:32.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 Processor -- start 2024-05-12T22:52:32.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 -- start start 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad3c148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad3c0b2c50 0x7fad3c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3c0b6150 con 0x7fad3c13f050 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fad3c06f990 con 0x7fad3c0b2c50 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad4402b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c0708b0 con 0x7fad3c0b5d70 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad425c8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fad3c13f050 0x7fad3c13f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33558/0 (socket says 172.21.15.40:33558) 2024-05-12T22:52:32.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad425c8640 1 -- 172.21.15.40:0/2110678950 learned_addr learned my addr 172.21.15.40:0/2110678950 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 --2- 172.21.15.40:0/2110678950 >> v2:172.21.15.47:3300/0 conn(0x7fad3c0b2c50 0x7fad3c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad41dc7640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad3c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79318885 0 0) 0x7fad3c0b6150 con 0x7fad3c13f050 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad28003530 con 0x7fad3c13f050 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203195895 0 0) 0x7fad28003530 con 0x7fad3c13f050 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 msgr2=0x7fad3c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad3c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 >> v2:172.21.15.47:3300/0 conn(0x7fad3c0b2c50 msgr2=0x7fad3c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 --2- 172.21.15.40:0/2110678950 >> v2:172.21.15.47:3300/0 conn(0x7fad3c0b2c50 0x7fad3c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c06f620 con 0x7fad3c13f050 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fad34001a00 con 0x7fad3c13f050 2024-05-12T22:52:32.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 >> v1:172.21.15.40:6789/0 conn(0x7fad3c13f050 legacy=0x7fad3c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad280039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad28004d50 0x7fad280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c0708b0 con 0x7fad28003f70 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad2800b9d0 con 0x7fad28004d50 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fad2800bbd0 con 0x7fad3c0b5d70 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad41dc7640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad280039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 -- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 msgr2=0x7fad280039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad425c8640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad28004d50 0x7fad280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad280039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 -- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad28004d50 msgr2=0x7fad280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad28004d50 0x7fad280051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad415c6640 1 -- 172.21.15.40:0/2110678950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28003530 con 0x7fad28003f70 2024-05-12T22:52:32.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.127+0000 7fad41dc7640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c0b5d70 0x7fad280039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad415c6640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad28004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ae0 tx=0x7fad2c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92f4029758137c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0b2070 con 0x7fad28003f70 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c0a56a0 con 0x7fad28003f70 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad40dc5640 1 -- 172.21.15.40:0/2110678950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0096b0 con 0x7fad28003f70 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- 172.21.15.40:0/2110678950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 msgr2=0x7fad28004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 --2- 172.21.15.40:0/2110678950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad28004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ae0 tx=0x7fad2c01cab0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad425c8640 1 -- 172.21.15.40:0/2110678950 reap_dead start 2024-05-12T22:52:32.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- 172.21.15.40:0/2110678950 shutdown_connections 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- 172.21.15.40:0/2110678950 >> 172.21.15.40:0/2110678950 conn(0x7fad3c06b6c0 msgr2=0x7fad3c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- 172.21.15.40:0/2110678950 shutdown_connections 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- 172.21.15.40:0/2110678950 wait complete. 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 Processor -- start 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- start start 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad3c142090 0x7fad3c142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c1e2d70 0x7fad3c1e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c1506e0 con 0x7fad28003f70 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c150560 con 0x7fad3c142090 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad4402b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c150860 con 0x7fad3c1e2d70 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59136/0 (socket says 172.21.15.40:59136) 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 -- 172.21.15.40:0/3192341647 learned_addr learned my addr 172.21.15.40:0/3192341647 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad415c6640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad3c142090 0x7fad3c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad425c8640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c1e2d70 0x7fad3c1e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 -- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c1e2d70 msgr2=0x7fad3c1e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c1e2d70 0x7fad3c1e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 -- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad3c142090 msgr2=0x7fad3c142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad3c142090 0x7fad3c142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.131+0000 7fad41dc7640 1 -- 172.21.15.40:0/3192341647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c141520 con 0x7fad28003f70 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad41dc7640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad380108d0 tx=0x7fad38010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800f040 con 0x7fad28003f70 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad38004220 con 0x7fad28003f70 2024-05-12T22:52:32.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800e960 con 0x7fad28003f70 2024-05-12T22:52:32.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c142a50 con 0x7fad28003f70 2024-05-12T22:52:32.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c140190 con 0x7fad28003f70 2024-05-12T22:52:32.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c068330 con 0x7fad28003f70 2024-05-12T22:52:32.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad3800eb00 con 0x7fad28003f70 2024-05-12T22:52:32.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 0x7fad20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fad38085a10 con 0x7fad28003f70 2024-05-12T22:52:32.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad415c6640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 0x7fad20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.135+0000 7fad415c6640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 0x7fad20069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ae0 tx=0x7fad2c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.139+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fad3c142a50 con 0x7fad28003f70 2024-05-12T22:52:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.303+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad3c141790 con 0x7fad28003f70 2024-05-12T22:52:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad327fc640 1 -- 172.21.15.40:0/3192341647 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12812 (secure 0 0 0) 0x7fad38018030 con 0x7fad28003f70 2024-05-12T22:52:32.307 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:32.307 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:23.473645+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 msgr2=0x7fad20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 0x7fad20069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ae0 tx=0x7fad2c0046d0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 msgr2=0x7fad3c0aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad380108d0 tx=0x7fad38010d90 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 shutdown_connections 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad3c1e2d70 0x7fad3c1e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fad200678c0 0x7fad20069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad3c142090 0x7fad3c142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 --2- 172.21.15.40:0/3192341647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad28003f70 0x7fad3c0aeb80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 >> 172.21.15.40:0/3192341647 conn(0x7fad3c06b6c0 msgr2=0x7fad3c145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 shutdown_connections 2024-05-12T22:52:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.307+0000 7fad4402b640 1 -- 172.21.15.40:0/3192341647 wait complete. 2024-05-12T22:52:32.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:52:32.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:52:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 Processor -- start 2024-05-12T22:52:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 -- start start 2024-05-12T22:52:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01080726e0 0x7f01080b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f0108144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080b1e90 con 0x7f01080b5d70 2024-05-12T22:52:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f01080b6150 con 0x7f01080726e0 2024-05-12T22:52:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010c907640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f01080b52e0 con 0x7f01081442c0 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f01080b5d70 0x7f0108071fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33574/0 (socket says 172.21.15.40:33574) 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010659c640 1 -- 172.21.15.40:0/1878543543 learned_addr learned my addr 172.21.15.40:0/1878543543 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1878543543 >> v2:172.21.15.47:3300/0 conn(0x7f01080726e0 0x7f01080b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0106d9d640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f0108144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470832907 0 0) 0x7f01080b1e90 con 0x7f01080b5d70 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f0003530 con 0x7f01080b5d70 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2534962324 0 0) 0x7f00f0003530 con 0x7f01080b5d70 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 msgr2=0x7f0108144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f0108144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 >> v2:172.21.15.47:3300/0 conn(0x7f01080726e0 msgr2=0x7f01080b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 --2- 172.21.15.40:0/1878543543 >> v2:172.21.15.47:3300/0 conn(0x7f01080726e0 0x7f01080b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0108144c90 con 0x7f01080b5d70 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f00f8001680 con 0x7f01080b5d70 2024-05-12T22:52:32.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 >> v1:172.21.15.40:6789/0 conn(0x7f01080b5d70 legacy=0x7f0108071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f00f00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f00f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00f0004d50 0x7f00f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f01080b6150 con 0x7f00f0003f40 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01080b52e0 con 0x7f00f0004d50 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f00f000bab0 con 0x7f01081442c0 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f00f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f010659c640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f00f00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0106d9d640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00f0004d50 0x7f00f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 -- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 msgr2=0x7f00f00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01081442c0 0x7f00f00039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 -- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00f0004d50 msgr2=0x7f00f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00f0004d50 0x7f00f00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.455+0000 7f0105d9b640 1 -- 172.21.15.40:0/1878543543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f0003530 con 0x7f00f0003f40 2024-05-12T22:52:32.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f00f0004810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009ab0 tx=0x7f00fc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0729716c47385e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0096b0 con 0x7f00f0003f40 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc0a6470 con 0x7f00f0003f40 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010559a640 1 -- 172.21.15.40:0/1878543543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0a6860 con 0x7f00f0003f40 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- 172.21.15.40:0/1878543543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 msgr2=0x7f00f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 --2- 172.21.15.40:0/1878543543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f00f0004810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009ab0 tx=0x7f00fc01ca90 comp rx=0 tx=0).stop 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f0106d9d640 1 -- 172.21.15.40:0/1878543543 reap_dead start 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- 172.21.15.40:0/1878543543 shutdown_connections 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- 172.21.15.40:0/1878543543 >> 172.21.15.40:0/1878543543 conn(0x7f010806b6c0 msgr2=0x7f010806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- 172.21.15.40:0/1878543543 shutdown_connections 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- 172.21.15.40:0/1878543543 wait complete. 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 Processor -- start 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- start start 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01080b82a0 0x7f01081e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 0x7f010813ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f010814f3a0 con 0x7f00f0003f40 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f010814f220 con 0x7f01081433d0 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010c907640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f010814f520 con 0x7f01080b82a0 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59154/0 (socket says 172.21.15.40:59154) 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.459+0000 7f010659c640 1 -- 172.21.15.40:0/1143067597 learned_addr learned my addr 172.21.15.40:0/1143067597 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f0106d9d640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 0x7f010813ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01080b82a0 0x7f01081e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 -- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01080b82a0 msgr2=0x7f01081e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01080b82a0 0x7f01081e12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 -- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 msgr2=0x7f010813ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 0x7f010813ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 -- 172.21.15.40:0/1143067597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0108143e10 con 0x7f00f0003f40 2024-05-12T22:52:32.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f0106d9d640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 0x7f010813ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010659c640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00f800d7a0 tx=0x7f00f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8019070 con 0x7f00f0003f40 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f800de50 con 0x7f00f0003f40 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01081e1820 con 0x7f00f0003f40 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f80047f0 con 0x7f00f0003f40 2024-05-12T22:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0108143860 con 0x7f00f0003f40 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0108068330 con 0x7f00f0003f40 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00f801c070 con 0x7f00f0003f40 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f00f8085320 con 0x7f00f0003f40 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.463+0000 7f0105d9b640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 0x7f00e8069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.467+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f00f80561a0 con 0x7f00f0003f40 2024-05-12T22:52:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.623+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0108142d10 con 0x7f00f0003f40 2024-05-12T22:52:32.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.623+0000 7f00f6ffd640 1 -- 172.21.15.40:0/1143067597 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f00f8055aa0 con 0x7f00f0003f40 2024-05-12T22:52:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:52:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 msgr2=0x7f00e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 0x7f00e8069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0046d0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 msgr2=0x7f01080abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00f800d7a0 tx=0x7f00f800dc60 comp rx=0 tx=0).stop 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 shutdown_connections 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01081433d0 0x7f010813ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01080b82a0 0x7f01081e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 --2- 172.21.15.40:0/1143067597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0003f40 0x7f01080abb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 >> 172.21.15.40:0/1143067597 conn(0x7f010806b6c0 msgr2=0x7f0108072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 shutdown_connections 2024-05-12T22:52:32.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.627+0000 7f010c907640 1 -- 172.21.15.40:0/1143067597 wait complete. 2024-05-12T22:52:32.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-12T22:52:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.763+0000 7f4cadc5b640 1 Processor -- start 2024-05-12T22:52:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.763+0000 7f4cadc5b640 1 -- start start 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4cadc5b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4ca8148460 0x7f4ca80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4cadc5b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ca813df10 0x7f4ca813e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4cadc5b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca80b6150 con 0x7f4ca80b5d70 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4cadc5b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca8147fd0 con 0x7f4ca813df10 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4cadc5b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca806f7e0 con 0x7f4ca8148460 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ca813df10 0x7f4ca813e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ca813df10 0x7f4ca813e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59160/0 (socket says 172.21.15.40:59160) 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 -- 172.21.15.40:0/980191550 learned_addr learned my addr 172.21.15.40:0/980191550 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca6ffd640 1 --2- 172.21.15.40:0/980191550 >> v2:172.21.15.47:3300/0 conn(0x7f4ca8148460 0x7f4ca80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 -- 172.21.15.40:0/980191550 >> v2:172.21.15.47:3300/0 conn(0x7f4ca8148460 msgr2=0x7f4ca80b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 --2- 172.21.15.40:0/980191550 >> v2:172.21.15.47:3300/0 conn(0x7f4ca8148460 0x7f4ca80b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 -- 172.21.15.40:0/980191550 >> v1:172.21.15.47:6789/0 conn(0x7f4ca80b5d70 legacy=0x7f4ca8144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 -- 172.21.15.40:0/980191550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8147980 con 0x7f4ca813df10 2024-05-12T22:52:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca7fff640 1 --2- 172.21.15.40:0/980191550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca813df10 0x7f4ca813e380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80b2c40 tx=0x7f4ca001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e08f797490eaf server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca67fc640 1 -- 172.21.15.40:0/980191550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00a5700 con 0x7f4ca813df10 2024-05-12T22:52:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca67fc640 1 -- 172.21.15.40:0/980191550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca00a58a0 con 0x7f4ca813df10 2024-05-12T22:52:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.767+0000 7f4ca67fc640 1 -- 172.21.15.40:0/980191550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00a5c70 con 0x7f4ca813df10 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/980191550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca813df10 msgr2=0x7f4ca813e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/980191550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca813df10 0x7f4ca813e380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80b2c40 tx=0x7f4ca001c930 comp rx=0 tx=0).stop 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/980191550 shutdown_connections 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/980191550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca813df10 0x7f4ca813e380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/980191550 >> v2:172.21.15.47:3300/0 conn(0x7f4ca8148460 0x7f4ca80b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/980191550 >> 172.21.15.40:0/980191550 conn(0x7f4ca806b6c0 msgr2=0x7f4ca806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/980191550 shutdown_connections 2024-05-12T22:52:32.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/980191550 wait complete. 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 Processor -- start 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- start start 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ca813df10 0x7f4ca813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 0x7f4ca813f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca814f4a0 con 0x7f4ca80b5d70 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca814f320 con 0x7f4ca813df10 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca814f620 con 0x7f4ca8148460 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59166/0 (socket says 172.21.15.40:59166) 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 -- 172.21.15.40:0/1468412939 learned_addr learned my addr 172.21.15.40:0/1468412939 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca7fff640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 0x7f4ca813f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca6ffd640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ca813df10 0x7f4ca813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 -- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 msgr2=0x7f4ca813f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 0x7f4ca813f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 -- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ca813df10 msgr2=0x7f4ca813f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ca813df10 0x7f4ca813f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 -- 172.21.15.40:0/1468412939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8140c70 con 0x7f4ca80b5d70 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca7fff640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 0x7f4ca813f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4ca77fe640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c420 tx=0x7f4c9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c980052d0 con 0x7f4ca80b5d70 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98005470 con 0x7f4ca80b5d70 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca8140f50 con 0x7f4ca80b5d70 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98007260 con 0x7f4ca80b5d70 2024-05-12T22:52:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.771+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca8071b20 con 0x7f4ca80b5d70 2024-05-12T22:52:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca813ef30 con 0x7f4ca80b5d70 2024-05-12T22:52:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c98007400 con 0x7f4ca80b5d70 2024-05-12T22:52:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4c8ffff640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:32.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4c98084d50 con 0x7f4ca80b5d70 2024-05-12T22:52:32.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4ca6ffd640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:32.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.775+0000 7f4ca6ffd640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 0x7f4c94069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8073240 tx=0x7f4c9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.779+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4ca813ef30 con 0x7f4ca80b5d70 2024-05-12T22:52:32.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.939+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4ca8068330 con 0x7f4ca80b5d70 2024-05-12T22:52:32.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.939+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1468412939 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f4c98088030 con 0x7f4ca80b5d70 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-05-12T22:52:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-05-12T22:52:32.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 msgr2=0x7f4c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 0x7f4c94069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8073240 tx=0x7f4c9c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:32.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 msgr2=0x7f4ca81416d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:32.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c420 tx=0x7f4c9800c8e0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 shutdown_connections 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ca8148460 0x7f4ca813f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ca813df10 0x7f4ca813f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 --2- 172.21.15.40:0/1468412939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca80b5d70 0x7f4ca81416d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 >> 172.21.15.40:0/1468412939 conn(0x7f4ca806b6c0 msgr2=0x7f4ca80b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 shutdown_connections 2024-05-12T22:52:32.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:32.943+0000 7f4cadc5b640 1 -- 172.21.15.40:0/1468412939 wait complete. 2024-05-12T22:52:32.960 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-12T22:52:32.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-12T22:52:33.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 Processor -- start 2024-05-12T22:52:33.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 -- start start 2024-05-12T22:52:33.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe9d00b5d70 0x7fe9d00b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d0142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d00b2f40 con 0x7fe9d01422a0 2024-05-12T22:52:33.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d0142c70 con 0x7fe9d00b5d70 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d6fe8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d00b6150 con 0x7fe9d0148f70 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d5585640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d0142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9d4d84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe9d00b5d70 0x7fe9d00b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9cffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe9d01422a0 0x7fe9d0148860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:49562/0 (socket says 172.21.15.40:49562) 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.083+0000 7fe9cffff640 1 -- 172.21.15.40:0/426339018 learned_addr learned my addr 172.21.15.40:0/426339018 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d5585640 1 -- 172.21.15.40:0/426339018 >> v2:172.21.15.47:3300/0 conn(0x7fe9d00b5d70 msgr2=0x7fe9d00b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:33.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d5585640 1 --2- 172.21.15.40:0/426339018 >> v2:172.21.15.47:3300/0 conn(0x7fe9d00b5d70 0x7fe9d00b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d5585640 1 -- 172.21.15.40:0/426339018 >> v1:172.21.15.47:6789/0 conn(0x7fe9d01422a0 legacy=0x7fe9d0148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d5585640 1 -- 172.21.15.40:0/426339018 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d00b4e70 con 0x7fe9d0148f70 2024-05-12T22:52:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d5585640 1 --2- 172.21.15.40:0/426339018 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d0142730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009d90 tx=0x7fe9c801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec863df51099484 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9cf7fe640 1 -- 172.21.15.40:0/426339018 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b2070 con 0x7fe9d0148f70 2024-05-12T22:52:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9cf7fe640 1 -- 172.21.15.40:0/426339018 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c80a5710 con 0x7fe9d0148f70 2024-05-12T22:52:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9cf7fe640 1 -- 172.21.15.40:0/426339018 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a5ae0 con 0x7fe9d0148f70 2024-05-12T22:52:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/426339018 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 msgr2=0x7fe9d0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/426339018 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d0142730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009d90 tx=0x7fe9c801c850 comp rx=0 tx=0).stop 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/426339018 shutdown_connections 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/426339018 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d0142730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/426339018 >> v2:172.21.15.47:3300/0 conn(0x7fe9d00b5d70 0x7fe9d00b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/426339018 >> 172.21.15.40:0/426339018 conn(0x7fe9d006b6c0 msgr2=0x7fe9d006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.087+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/426339018 shutdown_connections 2024-05-12T22:52:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/426339018 wait complete. 2024-05-12T22:52:33.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 Processor -- start 2024-05-12T22:52:33.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- start start 2024-05-12T22:52:33.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9d00b5d70 0x7fe9d014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d01dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0152710 con 0x7fe9d01422a0 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0152590 con 0x7fe9d00b5d70 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d0152890 con 0x7fe9d0148f70 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59174/0 (socket says 172.21.15.40:59174) 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 -- 172.21.15.40:0/2657156436 learned_addr learned my addr 172.21.15.40:0/2657156436 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d5585640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d01dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d4d84640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9d00b5d70 0x7fe9d014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 -- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 msgr2=0x7fe9d01dfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d01dfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 -- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9d00b5d70 msgr2=0x7fe9d014eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9d00b5d70 0x7fe9d014eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 -- 172.21.15.40:0/2657156436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d0072c40 con 0x7fe9d01422a0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cffff640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400c450 tx=0x7fe9c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4017070 con 0x7fe9d01422a0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4005cf0 con 0x7fe9d01422a0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4007290 con 0x7fe9d01422a0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d00b08b0 con 0x7fe9d01422a0 2024-05-12T22:52:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.091+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d00b0b90 con 0x7fe9d01422a0 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d0068330 con 0x7fe9d01422a0 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9c401a070 con 0x7fe9d01422a0 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9cd7fa640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 0x7fe9bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe9c4084ba0 con 0x7fe9d01422a0 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9d4d84640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 0x7fe9bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.095+0000 7fe9d4d84640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 0x7fe9bc069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9d014f7d0 tx=0x7fe9c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.099+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe9c4055ac0 con 0x7fe9d01422a0 2024-05-12T22:52:33.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.255+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe9d0141d30 con 0x7fe9d01422a0 2024-05-12T22:52:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.507+0000 7fe9cd7fa640 1 -- 172.21.15.40:0/2657156436 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fe9c40553c0 con 0x7fe9d01422a0 2024-05-12T22:52:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-05-12T22:52:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 msgr2=0x7fe9bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 0x7fe9bc069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9d014f7d0 tx=0x7fe9c0008040 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 msgr2=0x7fe9d0071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400c450 tx=0x7fe9c400c910 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 shutdown_connections 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe9d0148f70 0x7fe9d01dfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d01422a0 0x7fe9d0071d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe9bc0678c0 0x7fe9bc069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 --2- 172.21.15.40:0/2657156436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9d00b5d70 0x7fe9d014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 >> 172.21.15.40:0/2657156436 conn(0x7fe9d006b6c0 msgr2=0x7fe9d00b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 shutdown_connections 2024-05-12T22:52:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.511+0000 7fe9d6fe8640 1 -- 172.21.15.40:0/2657156436 wait complete. 2024-05-12T22:52:33.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-12T22:52:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 Processor -- start 2024-05-12T22:52:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 -- start start 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b6b90 0x7ff2b0141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2b00729e0 0x7ff2b01418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b00b6f70 con 0x7ff2b00b4fc0 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b00b5bc0 con 0x7ff2b00729e0 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.663+0000 7ff2b7ad3640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b0071cd0 con 0x7ff2b00b6b90 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2b00729e0 0x7ff2b01418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2b00729e0 0x7ff2b01418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59190/0 (socket says 172.21.15.40:59190) 2024-05-12T22:52:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 -- 172.21.15.40:0/1862373861 learned_addr learned my addr 172.21.15.40:0/1862373861 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:33.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b586f640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b6b90 0x7ff2b0141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 -- 172.21.15.40:0/1862373861 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b6b90 msgr2=0x7ff2b0141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:33.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b6b90 0x7ff2b0141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 -- 172.21.15.40:0/1862373861 >> v1:172.21.15.47:6789/0 conn(0x7ff2b00b4fc0 legacy=0x7ff2b00722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 -- 172.21.15.40:0/1862373861 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00b6220 con 0x7ff2b00729e0 2024-05-12T22:52:33.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b6070640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b01418c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009870 tx=0x7ff2ac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196f19f8b46848b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b486d640 1 -- 172.21.15.40:0/1862373861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0b2070 con 0x7ff2b00729e0 2024-05-12T22:52:33.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b486d640 1 -- 172.21.15.40:0/1862373861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0a9070 con 0x7ff2b00729e0 2024-05-12T22:52:33.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b486d640 1 -- 172.21.15.40:0/1862373861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0ad880 con 0x7ff2b00729e0 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/1862373861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 msgr2=0x7ff2b01418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b01418c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009870 tx=0x7ff2ac01c560 comp rx=0 tx=0).stop 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/1862373861 shutdown_connections 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b01418c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/1862373861 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b6b90 0x7ff2b0141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/1862373861 >> 172.21.15.40:0/1862373861 conn(0x7ff2b00ba070 msgr2=0x7ff2b00ba480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:33.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/1862373861 shutdown_connections 2024-05-12T22:52:33.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.667+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/1862373861 wait complete. 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 Processor -- start 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- start start 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b4fc0 0x7ff2b01451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 0x7ff2b01456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b01547d0 con 0x7ff2b00729e0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0154650 con 0x7ff2b00b6b90 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b0154950 con 0x7ff2b00b4fc0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59204/0 (socket says 172.21.15.40:59204) 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 -- 172.21.15.40:0/4197113326 learned_addr learned my addr 172.21.15.40:0/4197113326 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b6070640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 0x7ff2b01456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b506e640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b4fc0 0x7ff2b01451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 -- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b4fc0 msgr2=0x7ff2b01451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b4fc0 0x7ff2b01451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 -- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 msgr2=0x7ff2b01456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 0x7ff2b01456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 -- 172.21.15.40:0/4197113326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00aff30 con 0x7ff2b00729e0 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b6070640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 0x7ff2b01456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:33.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b586f640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8007e90 tx=0x7ff2a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8014620 con 0x7ff2b00729e0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8019070 con 0x7ff2b00729e0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b00af1c0 con 0x7ff2b00729e0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8014a20 con 0x7ff2b00729e0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b0151b40 con 0x7ff2b00729e0 2024-05-12T22:52:33.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b0068a40 con 0x7ff2b00729e0 2024-05-12T22:52:33.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2a8014bc0 con 0x7ff2b00729e0 2024-05-12T22:52:33.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 0x7ff294069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:33.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2b506e640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 0x7ff294069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:33.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.671+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7ff2a8086300 con 0x7ff2b00729e0 2024-05-12T22:52:33.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.675+0000 7ff2b506e640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 0x7ff294069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:33.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.679+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff2a8011260 con 0x7ff2b00729e0 2024-05-12T22:52:33.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:33.839+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff2b00b8400 con 0x7ff2b00729e0 2024-05-12T22:52:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.519+0000 7ff2a67fc640 1 -- 172.21.15.40:0/4197113326 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7ff2a80570b0 con 0x7ff2b00729e0 2024-05-12T22:52:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 msgr2=0x7ff294069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 0x7ff294069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 msgr2=0x7ff2b0147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8007e90 tx=0x7ff2a800e4b0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 shutdown_connections 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff2940678c0 0x7ff294069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2b00b6b90 0x7ff2b01456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff2b00b4fc0 0x7ff2b01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 --2- 172.21.15.40:0/4197113326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2b00729e0 0x7ff2b0147fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 >> 172.21.15.40:0/4197113326 conn(0x7ff2b00ba070 msgr2=0x7ff2b006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 shutdown_connections 2024-05-12T22:52:34.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.523+0000 7ff2b7ad3640 1 -- 172.21.15.40:0/4197113326 wait complete. 2024-05-12T22:52:34.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-12T22:52:34.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 Processor -- start 2024-05-12T22:52:34.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 -- start start 2024-05-12T22:52:34.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36ec0b5d70 0x7f36ec0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36ec0aecf0 0x7f36ec072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec0b6150 con 0x7f36ec0ad8d0 2024-05-12T22:52:34.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec0b54d0 con 0x7f36ec0aecf0 2024-05-12T22:52:34.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36f0f7e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec0ae1f0 con 0x7f36ec0b5d70 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36ec0aecf0 0x7f36ec072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36ec0aecf0 0x7f36ec072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59206/0 (socket says 172.21.15.40:59206) 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 -- 172.21.15.40:0/410482745 learned_addr learned my addr 172.21.15.40:0/410482745 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36ea59c640 1 --2- 172.21.15.40:0/410482745 >> v2:172.21.15.47:3300/0 conn(0x7f36ec0b5d70 0x7f36ec0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 -- 172.21.15.40:0/410482745 >> v2:172.21.15.47:3300/0 conn(0x7f36ec0b5d70 msgr2=0x7f36ec0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 --2- 172.21.15.40:0/410482745 >> v2:172.21.15.47:3300/0 conn(0x7f36ec0b5d70 0x7f36ec0726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 -- 172.21.15.40:0/410482745 >> v1:172.21.15.47:6789/0 conn(0x7f36ec0ad8d0 legacy=0x7f36ec1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 -- 172.21.15.40:0/410482745 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec0b4e80 con 0x7f36ec0aecf0 2024-05-12T22:52:34.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.679+0000 7f36e9d9b640 1 --2- 172.21.15.40:0/410482745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec072c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0b5650 tx=0x7f36e001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6296e054b469c34c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:34.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e959a640 1 -- 172.21.15.40:0/410482745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00b1070 con 0x7f36ec0aecf0 2024-05-12T22:52:34.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e959a640 1 -- 172.21.15.40:0/410482745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e00ac410 con 0x7f36ec0aecf0 2024-05-12T22:52:34.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e959a640 1 -- 172.21.15.40:0/410482745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00ac7e0 con 0x7f36ec0aecf0 2024-05-12T22:52:34.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/410482745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 msgr2=0x7f36ec072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:34.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/410482745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec072c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0b5650 tx=0x7f36e001c390 comp rx=0 tx=0).stop 2024-05-12T22:52:34.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/410482745 shutdown_connections 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/410482745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec072c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/410482745 >> v2:172.21.15.47:3300/0 conn(0x7f36ec0b5d70 0x7f36ec0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/410482745 >> 172.21.15.40:0/410482745 conn(0x7f36ec06b6c0 msgr2=0x7f36ec06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/410482745 shutdown_connections 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/410482745 wait complete. 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 Processor -- start 2024-05-12T22:52:34.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- start start 2024-05-12T22:52:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 0x7f36ec13db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 0x7f36ec1e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec154910 con 0x7f36ec0aecf0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec154790 con 0x7f36ec0b5d70 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec154a90 con 0x7f36ec0ad8d0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59214/0 (socket says 172.21.15.40:59214) 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 -- 172.21.15.40:0/1570544021 learned_addr learned my addr 172.21.15.40:0/1570544021 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36ea59c640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 0x7f36ec13db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36ead9d640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 0x7f36ec1e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 -- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 msgr2=0x7f36ec13db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 0x7f36ec13db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 -- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 msgr2=0x7f36ec1e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 0x7f36ec1e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 -- 172.21.15.40:0/1570544021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec0ae840 con 0x7f36ec0aecf0 2024-05-12T22:52:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36ea59c640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 0x7f36ec13db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36ead9d640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 0x7f36ec1e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36e9d9b640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36e0019fc0 tx=0x7f36e0019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00bc070 con 0x7f36ec0aecf0 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e00ab640 con 0x7f36ec0aecf0 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00b1070 con 0x7f36ec0aecf0 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.683+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec0b1ab0 con 0x7f36ec0aecf0 2024-05-12T22:52:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec13ae40 con 0x7f36ec0aecf0 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec068330 con 0x7f36ec0aecf0 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36e00aba30 con 0x7f36ec0aecf0 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36daffd640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 0x7f36cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f36e011f7a0 con 0x7f36ec0aecf0 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36ea59c640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 0x7f36cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:34.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.687+0000 7f36ea59c640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 0x7f36cc069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097a0 tx=0x7f36dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:34.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.691+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f36e00160d0 con 0x7f36ec0aecf0 2024-05-12T22:52:34.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:34.891+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36ec1450b0 con 0x7f36ec0aecf0 2024-05-12T22:52:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.519+0000 7f36daffd640 1 -- 172.21.15.40:0/1570544021 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f36e00f02b0 con 0x7f36ec0aecf0 2024-05-12T22:52:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 msgr2=0x7f36cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 0x7f36cc069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097a0 tx=0x7f36dc008040 comp rx=0 tx=0).stop 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 msgr2=0x7f36ec1e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36e0019fc0 tx=0x7f36e0019130 comp rx=0 tx=0).stop 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 shutdown_connections 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f36cc0678f0 0x7f36cc069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0b5d70 0x7f36ec1e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36ec0aecf0 0x7f36ec1e00c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 --2- 172.21.15.40:0/1570544021 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f36ec0ad8d0 0x7f36ec13db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 >> 172.21.15.40:0/1570544021 conn(0x7f36ec06b6c0 msgr2=0x7f36ec0b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 shutdown_connections 2024-05-12T22:52:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.523+0000 7f36f0f7e640 1 -- 172.21.15.40:0/1570544021 wait complete. 2024-05-12T22:52:35.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 Processor -- start 2024-05-12T22:52:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 -- start start 2024-05-12T22:52:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa200af9f0 0x7faa20143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa200b1610 con 0x7faa20144390 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa200b0320 con 0x7faa200b1b20 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.683+0000 7faa26959640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7faa200b0e00 con 0x7faa200af9f0 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa177fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa200af9f0 0x7faa20143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa24ef6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa20144390 0x7faa2014e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33576/0 (socket says 172.21.15.40:33576) 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa24ef6640 1 -- 172.21.15.40:0/307242547 learned_addr learned my addr 172.21.15.40:0/307242547 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa177fe640 1 -- 172.21.15.40:0/307242547 >> v1:172.21.15.47:6789/0 conn(0x7faa200b1b20 legacy=0x7faa200b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa177fe640 1 -- 172.21.15.40:0/307242547 >> v1:172.21.15.40:6789/0 conn(0x7faa20144390 legacy=0x7faa2014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa1f7fe640 1 -- 172.21.15.40:0/307242547 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494989786 0 0) 0x7faa200b1610 con 0x7faa20144390 2024-05-12T22:52:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa177fe640 1 -- 172.21.15.40:0/307242547 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200b0600 con 0x7faa200af9f0 2024-05-12T22:52:35.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa177fe640 1 --2- 172.21.15.40:0/307242547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa200af9f0 0x7faa20143e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa080097c0 tx=0x7faa0801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373105e00a4315e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:35.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa1f7fe640 1 -- 172.21.15.40:0/307242547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b0070 con 0x7faa200af9f0 2024-05-12T22:52:35.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa1f7fe640 1 -- 172.21.15.40:0/307242547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080ab600 con 0x7faa200af9f0 2024-05-12T22:52:35.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa1f7fe640 1 -- 172.21.15.40:0/307242547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ab9d0 con 0x7faa200af9f0 2024-05-12T22:52:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 -- 172.21.15.40:0/307242547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa200af9f0 msgr2=0x7faa20143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 --2- 172.21.15.40:0/307242547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa200af9f0 0x7faa20143e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa080097c0 tx=0x7faa0801c3d0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 -- 172.21.15.40:0/307242547 shutdown_connections 2024-05-12T22:52:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 --2- 172.21.15.40:0/307242547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa200af9f0 0x7faa20143e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 -- 172.21.15.40:0/307242547 >> 172.21.15.40:0/307242547 conn(0x7faa2006b6c0 msgr2=0x7faa2006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 -- 172.21.15.40:0/307242547 shutdown_connections 2024-05-12T22:52:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.687+0000 7faa26959640 1 -- 172.21.15.40:0/307242547 wait complete. 2024-05-12T22:52:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 Processor -- start 2024-05-12T22:52:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- start start 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa200af9f0 0x7faa200aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa200b1b20 0x7faa201dda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa201447c0 con 0x7faa20144390 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa200b3d20 con 0x7faa200af9f0 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7faa20152a30 con 0x7faa200b1b20 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59242/0 (socket says 172.21.15.40:59242) 2024-05-12T22:52:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 -- 172.21.15.40:0/2066635878 learned_addr learned my addr 172.21.15.40:0/2066635878 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa1ffff640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa200af9f0 0x7faa200aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa177fe640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa200b1b20 0x7faa201dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 -- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa200b1b20 msgr2=0x7faa201dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa200b1b20 0x7faa201dda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 -- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa200af9f0 msgr2=0x7faa200aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa200af9f0 0x7faa200aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 -- 172.21.15.40:0/2066635878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200ac440 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa24ef6640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c730 tx=0x7faa1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18018070 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1800ce40 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa200aae50 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1800a860 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa200ab670 con 0x7faa20144390 2024-05-12T22:52:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.691+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa20068330 con 0x7faa20144390 2024-05-12T22:52:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.695+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa1801b070 con 0x7faa20144390 2024-05-12T22:52:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.695+0000 7faa1d7fa640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 0x7faa00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.695+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa18085180 con 0x7faa20144390 2024-05-12T22:52:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.695+0000 7faa1ffff640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 0x7faa00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.695+0000 7faa1ffff640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 0x7faa00069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa10004e30 tx=0x7faa10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.699+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faa18055d50 con 0x7faa20144390 2024-05-12T22:52:35.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.859+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa200af5b0 con 0x7faa20144390 2024-05-12T22:52:35.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.863+0000 7faa1d7fa640 1 -- 172.21.15.40:0/2066635878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16546 (secure 0 0 0) 0x7faa18055650 con 0x7faa20144390 2024-05-12T22:52:35.864 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:35.865 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:34.893822+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 msgr2=0x7faa00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 0x7faa00069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa10004e30 tx=0x7faa10009040 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 msgr2=0x7faa200a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c730 tx=0x7faa1800cbf0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 shutdown_connections 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20144390 0x7faa200a9a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa200b1b20 0x7faa201dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faa000678c0 0x7faa00069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 --2- 172.21.15.40:0/2066635878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa200af9f0 0x7faa200aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 >> 172.21.15.40:0/2066635878 conn(0x7faa2006b6c0 msgr2=0x7faa20141890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 shutdown_connections 2024-05-12T22:52:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:35.867+0000 7faa26959640 1 -- 172.21.15.40:0/2066635878 wait complete. 2024-05-12T22:52:35.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:36.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.007+0000 7f16cf6c1640 1 Processor -- start 2024-05-12T22:52:36.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 -- start start 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c8149070 0x7f16c813f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b2c50 0x7f16c813f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c80b6150 con 0x7f16c80b5d70 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f16c806f990 con 0x7f16c80b2c50 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cf6c1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f16c80708b0 con 0x7f16c8149070 2024-05-12T22:52:36.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b2c50 0x7f16c813f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b2c50 0x7f16c813f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59258/0 (socket says 172.21.15.40:59258) 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 -- 172.21.15.40:0/205639321 learned_addr learned my addr 172.21.15.40:0/205639321 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16ccc5c640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c8149070 0x7f16c813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 -- 172.21.15.40:0/205639321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c8149070 msgr2=0x7f16c813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c8149070 0x7f16c813f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 -- 172.21.15.40:0/205639321 >> v1:172.21.15.47:6789/0 conn(0x7f16c80b5d70 legacy=0x7f16c8148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 -- 172.21.15.40:0/205639321 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c806f620 con 0x7f16c80b2c50 2024-05-12T22:52:36.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16cdc5e640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c813f590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16c00098a0 tx=0x7f16c001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27765c48f9dc69 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16bbfff640 1 -- 172.21.15.40:0/205639321 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00aa430 con 0x7f16c80b2c50 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16bbfff640 1 -- 172.21.15.40:0/205639321 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c00af070 con 0x7f16c80b2c50 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.011+0000 7f16bbfff640 1 -- 172.21.15.40:0/205639321 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00aa7f0 con 0x7f16c80b2c50 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/205639321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 msgr2=0x7f16c813f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c813f590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16c00098a0 tx=0x7f16c001c4b0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/205639321 shutdown_connections 2024-05-12T22:52:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c813f590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/205639321 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c8149070 0x7f16c813f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/205639321 >> 172.21.15.40:0/205639321 conn(0x7f16c806b6c0 msgr2=0x7f16c806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/205639321 shutdown_connections 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/205639321 wait complete. 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 Processor -- start 2024-05-12T22:52:36.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- start start 2024-05-12T22:52:36.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c80b5d70 0x7f16c81430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c8149070 0x7f16c81e3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81526f0 con 0x7f16c80b2c50 2024-05-12T22:52:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8152570 con 0x7f16c8149070 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f16c8152870 con 0x7f16c80b5d70 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59268/0 (socket says 172.21.15.40:59268) 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 -- 172.21.15.40:0/1860882485 learned_addr learned my addr 172.21.15.40:0/1860882485 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cdc5e640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c8149070 0x7f16c81e3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16ccc5c640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c80b5d70 0x7f16c81430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 -- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c80b5d70 msgr2=0x7f16c81430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c80b5d70 0x7f16c81430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 -- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c8149070 msgr2=0x7f16c81e3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c8149070 0x7f16c81e3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 -- 172.21.15.40:0/1860882485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c8144480 con 0x7f16c80b2c50 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cd45d640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c420 tx=0x7f16bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0052d0 con 0x7f16c80b2c50 2024-05-12T22:52:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc005470 con 0x7f16c80b2c50 2024-05-12T22:52:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c8144700 con 0x7f16c80b2c50 2024-05-12T22:52:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc007260 con 0x7f16c80b2c50 2024-05-12T22:52:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.015+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c8143630 con 0x7f16c80b2c50 2024-05-12T22:52:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c8068330 con 0x7f16c80b2c50 2024-05-12T22:52:36.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16bc007400 con 0x7f16c80b2c50 2024-05-12T22:52:36.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16b9ffb640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 0x7f16ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f16bc085140 con 0x7f16c80b2c50 2024-05-12T22:52:36.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16ccc5c640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 0x7f16ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.019+0000 7f16ccc5c640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 0x7f16ac069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16c4003fd0 tx=0x7f16c40039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.023+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f16c8144480 con 0x7f16c80b2c50 2024-05-12T22:52:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.183+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16c81e0100 con 0x7f16c80b2c50 2024-05-12T22:52:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.183+0000 7f16b9ffb640 1 -- 172.21.15.40:0/1860882485 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16546 (secure 0 0 0) 0x7f16bc055d10 con 0x7f16c80b2c50 2024-05-12T22:52:36.186 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:36.186 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:34.893822+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 msgr2=0x7f16ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 0x7f16ac069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16c4003fd0 tx=0x7f16c40039a0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 msgr2=0x7f16c8143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c420 tx=0x7f16bc00c8e0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 shutdown_connections 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f16ac0678c0 0x7f16ac069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c8149070 0x7f16c81e3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f16c80b5d70 0x7f16c81430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 --2- 172.21.15.40:0/1860882485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b2c50 0x7f16c8143f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 >> 172.21.15.40:0/1860882485 conn(0x7f16c806b6c0 msgr2=0x7f16c80b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 shutdown_connections 2024-05-12T22:52:36.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.187+0000 7f16cf6c1640 1 -- 172.21.15.40:0/1860882485 wait complete. 2024-05-12T22:52:36.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-12T22:52:36.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 Processor -- start 2024-05-12T22:52:36.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 -- start start 2024-05-12T22:52:36.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f119c147730 0x7f119c147da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c141380 0x7f119c141800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c147b10 con 0x7f119c14aa30 2024-05-12T22:52:36.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f119c0b6d10 con 0x7f119c147730 2024-05-12T22:52:36.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f11a1c70640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f119c0b5c20 con 0x7f119c141380 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f119c147730 0x7f119c147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f119c147730 0x7f119c147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59278/0 (socket says 172.21.15.40:59278) 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 -- 172.21.15.40:0/2240076655 learned_addr learned my addr 172.21.15.40:0/2240076655 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119affd640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c141380 0x7f119c141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 -- 172.21.15.40:0/2240076655 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c141380 msgr2=0x7f119c141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c141380 0x7f119c141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 -- 172.21.15.40:0/2240076655 >> v1:172.21.15.47:6789/0 conn(0x7f119c14aa30 legacy=0x7f119c14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:36.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.319+0000 7f119b7fe640 1 -- 172.21.15.40:0/2240076655 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c0b4660 con 0x7f119c147730 2024-05-12T22:52:36.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c147730 0x7f119c147da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1184009e80 tx=0x7f118401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc346c1d3ab1b94 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119a7fc640 1 -- 172.21.15.40:0/2240076655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840a5700 con 0x7f119c147730 2024-05-12T22:52:36.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119a7fc640 1 -- 172.21.15.40:0/2240076655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840a58a0 con 0x7f119c147730 2024-05-12T22:52:36.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119a7fc640 1 -- 172.21.15.40:0/2240076655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840a5c70 con 0x7f119c147730 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- 172.21.15.40:0/2240076655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c147730 msgr2=0x7f119c147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c147730 0x7f119c147da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1184009e80 tx=0x7f118401c880 comp rx=0 tx=0).stop 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- 172.21.15.40:0/2240076655 shutdown_connections 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c141380 0x7f119c141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2240076655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c147730 0x7f119c147da0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- 172.21.15.40:0/2240076655 >> 172.21.15.40:0/2240076655 conn(0x7f119c0bce70 msgr2=0x7f119c0bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- 172.21.15.40:0/2240076655 shutdown_connections 2024-05-12T22:52:36.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- 172.21.15.40:0/2240076655 wait complete. 2024-05-12T22:52:36.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 Processor -- start 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- start start 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 0x7f119c1e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 0x7f119c144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b9520 con 0x7f119c141380 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b4f50 con 0x7f119c14aa30 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f11a1c70640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f119c1482e0 con 0x7f119c147730 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59280/0 (socket says 172.21.15.40:59280) 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 -- 172.21.15.40:0/2810556718 learned_addr learned my addr 172.21.15.40:0/2810556718 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119affd640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 0x7f119c1e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119bfff640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 0x7f119c144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 -- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 msgr2=0x7f119c1e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 0x7f119c1e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 -- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 msgr2=0x7f119c144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 0x7f119c144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119b7fe640 1 -- 172.21.15.40:0/2810556718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c143cc0 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119affd640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 0x7f119c1e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.323+0000 7f119bfff640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 0x7f119c144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f119b7fe640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f118401af30 tx=0x7f1184019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840bc020 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840b8670 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c13bd60 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840b8a40 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1438f0 con 0x7f119c141380 2024-05-12T22:52:36.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c1e3570 con 0x7f119c141380 2024-05-12T22:52:36.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11840bf020 con 0x7f119c141380 2024-05-12T22:52:36.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 0x7f1180069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1184120cf0 con 0x7f119c141380 2024-05-12T22:52:36.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f119affd640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 0x7f1180069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.327+0000 7f119affd640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 0x7f1180069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f119c148130 tx=0x7f1194008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.331+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f11840c6030 con 0x7f119c141380 2024-05-12T22:52:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.523+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f119c068330 con 0x7f119c141380 2024-05-12T22:52:36.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.539+0000 7f1193fff640 1 -- 172.21.15.40:0/2810556718 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f119c143cc0 con 0x7f119c141380 2024-05-12T22:52:36.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 msgr2=0x7f1180069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 0x7f1180069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f119c148130 tx=0x7f1194008040 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 msgr2=0x7f119c1390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f118401af30 tx=0x7f1184019620 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 shutdown_connections 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f11800678c0 0x7f1180069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c14aa30 0x7f119c144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c147730 0x7f119c1e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 --2- 172.21.15.40:0/2810556718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f119c141380 0x7f119c1390a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 >> 172.21.15.40:0/2810556718 conn(0x7f119c0bce70 msgr2=0x7f119c13a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 shutdown_connections 2024-05-12T22:52:36.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.543+0000 7f11a1c70640 1 -- 172.21.15.40:0/2810556718 wait complete. 2024-05-12T22:52:36.559 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-12T22:52:36.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-12T22:52:36.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 Processor -- start 2024-05-12T22:52:36.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 -- start start 2024-05-12T22:52:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f1094141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1094141a50 0x7f109406d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940b8120 con 0x7f10940b7d40 2024-05-12T22:52:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f10940b6ce0 con 0x7f1094141a50 2024-05-12T22:52:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109b603640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f10940b7170 con 0x7f1094072f20 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1098b9e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f1094141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1094141a50 0x7f109406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1094141a50 0x7f109406d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:48490/0 (socket says 172.21.15.40:48490) 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f109939f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f10940b7d40 0x7f10940b5bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:49612/0 (socket says 172.21.15.40:49612) 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 -- 172.21.15.40:0/856977012 learned_addr learned my addr 172.21.15.40:0/856977012 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1098b9e640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f1094141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:36680/0 (socket says 172.21.15.40:36680) 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 -- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 msgr2=0x7f1094141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f1094141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 -- 172.21.15.40:0/856977012 >> v1:172.21.15.47:6789/0 conn(0x7f10940b7d40 legacy=0x7f10940b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.675+0000 7f1099ba0640 1 -- 172.21.15.40:0/856977012 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940b58e0 con 0x7f1094141a50 2024-05-12T22:52:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f1099ba0640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1094141a50 0x7f109406d350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f108c009e50 tx=0x7f108c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ec9d7092fea6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f108bfff640 1 -- 172.21.15.40:0/856977012 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0a57a0 con 0x7f1094141a50 2024-05-12T22:52:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f108bfff640 1 -- 172.21.15.40:0/856977012 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c0a5940 con 0x7f1094141a50 2024-05-12T22:52:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f108bfff640 1 -- 172.21.15.40:0/856977012 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0a5d10 con 0x7f1094141a50 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1094141a50 msgr2=0x7f109406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1094141a50 0x7f109406d350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f108c009e50 tx=0x7f108c01c9a0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- 172.21.15.40:0/856977012 shutdown_connections 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1094141a50 0x7f109406d350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 --2- 172.21.15.40:0/856977012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f1094141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- 172.21.15.40:0/856977012 >> 172.21.15.40:0/856977012 conn(0x7f109406b490 msgr2=0x7f109406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:36.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- 172.21.15.40:0/856977012 shutdown_connections 2024-05-12T22:52:36.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- 172.21.15.40:0/856977012 wait complete. 2024-05-12T22:52:36.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 Processor -- start 2024-05-12T22:52:36.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.679+0000 7f109b603640 1 -- start start 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f10940b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10940b7d40 0x7f10941e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f10941549b0 con 0x7f1094141a50 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1094154830 con 0x7f10940b7d40 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1094154b30 con 0x7f1094072f20 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59284/0 (socket says 172.21.15.40:59284) 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 -- 172.21.15.40:0/2145724628 learned_addr learned my addr 172.21.15.40:0/2145724628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109939f640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f10940b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1098b9e640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10940b7d40 0x7f10941e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 -- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 msgr2=0x7f10940b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f10940b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 -- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10940b7d40 msgr2=0x7f10941e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10940b7d40 0x7f10941e2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 -- 172.21.15.40:0/2145724628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940ba5a0 con 0x7f1094141a50 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1099ba0640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f108c01a5d0 tx=0x7f108c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0bc020 con 0x7f1094141a50 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c0b8880 con 0x7f1094141a50 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10940bae30 con 0x7f1094141a50 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c009510 con 0x7f1094141a50 2024-05-12T22:52:36.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10940ba2c0 con 0x7f1094141a50 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1094068a40 con 0x7f1094141a50 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f108c0bf020 con 0x7f1094141a50 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 0x7f1078069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f108c120fe0 con 0x7f1094141a50 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109939f640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 0x7f1078069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:36.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.683+0000 7f109939f640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 0x7f1078069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1094151bd0 tx=0x7f1084007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:36.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.691+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f108c0c6030 con 0x7f1094141a50 2024-05-12T22:52:36.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:36.879+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f10940678d0 con 0x7f1094141a50 2024-05-12T22:52:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.555+0000 7f1089ffb640 1 -- 172.21.15.40:0/2145724628 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f108c016620 con 0x7f1094141a50 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 msgr2=0x7f1078069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 0x7f1078069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1094151bd0 tx=0x7f1084007cf0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 msgr2=0x7f10941e33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f108c01a5d0 tx=0x7f108c019740 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 shutdown_connections 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1094141a50 0x7f10941e33a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f10780678c0 0x7f1078069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10940b7d40 0x7f10941e2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 --2- 172.21.15.40:0/2145724628 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1094072f20 0x7f10940b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 >> 172.21.15.40:0/2145724628 conn(0x7f109406b490 msgr2=0x7f1094071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:37.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 shutdown_connections 2024-05-12T22:52:37.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.559+0000 7f109b603640 1 -- 172.21.15.40:0/2145724628 wait complete. 2024-05-12T22:52:37.580 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-12T22:52:37.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:37.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.711+0000 7f82fe019640 1 Processor -- start 2024-05-12T22:52:37.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.711+0000 7f82fe019640 1 -- start start 2024-05-12T22:52:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82fe019640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82f80b5d70 0x7f82f8148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82fe019640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b2c50 0x7f82f8148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82fe019640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80b6150 con 0x7f82f813f050 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82fe019640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f82f806f990 con 0x7f82f80b5d70 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82fe019640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80708b0 con 0x7f82f80b2c50 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82f80b5d70 0x7f82f8148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f82f813f050 0x7f82f813f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33580/0 (socket says 172.21.15.40:33580) 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f7fff640 1 -- 172.21.15.40:0/1410915662 learned_addr learned my addr 172.21.15.40:0/1410915662 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 -- 172.21.15.40:0/1410915662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b2c50 msgr2=0x7f82f8148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 --2- 172.21.15.40:0/1410915662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b2c50 0x7f82f8148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 -- 172.21.15.40:0/1410915662 >> v1:172.21.15.40:6789/0 conn(0x7f82f813f050 legacy=0x7f82f813f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 -- 172.21.15.40:0/1410915662 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f806f620 con 0x7f82f80b5d70 2024-05-12T22:52:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f67fc640 1 -- 172.21.15.40:0/1410915662 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9120170 0 0) 0x7f82f80b6150 con 0x7f82f813f050 2024-05-12T22:52:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f77fe640 1 --2- 172.21.15.40:0/1410915662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b5d70 0x7f82f8148960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e80097f0 tx=0x7f82e801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86241e134208c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f67fc640 1 -- 172.21.15.40:0/1410915662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ab430 con 0x7f82f80b5d70 2024-05-12T22:52:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f67fc640 1 -- 172.21.15.40:0/1410915662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80b0070 con 0x7f82f80b5d70 2024-05-12T22:52:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.715+0000 7f82f67fc640 1 -- 172.21.15.40:0/1410915662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ab7f0 con 0x7f82f80b5d70 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/1410915662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b5d70 msgr2=0x7f82f8148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- 172.21.15.40:0/1410915662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b5d70 0x7f82f8148960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e80097f0 tx=0x7f82e801c410 comp rx=0 tx=0).stop 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/1410915662 shutdown_connections 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- 172.21.15.40:0/1410915662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b2c50 0x7f82f8148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- 172.21.15.40:0/1410915662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b5d70 0x7f82f8148960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/1410915662 >> 172.21.15.40:0/1410915662 conn(0x7f82f806b6c0 msgr2=0x7f82f806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/1410915662 shutdown_connections 2024-05-12T22:52:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/1410915662 wait complete. 2024-05-12T22:52:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 Processor -- start 2024-05-12T22:52:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- start start 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b5d70 0x7f82f80b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82f813f050 0x7f82f813dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f82f81526f0 con 0x7f82f80b2c50 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82f8152570 con 0x7f82f813f050 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f82f8152870 con 0x7f82f80b5d70 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59300/0 (socket says 172.21.15.40:59300) 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 -- 172.21.15.40:0/4003592323 learned_addr learned my addr 172.21.15.40:0/4003592323 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f7fff640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82f813f050 0x7f82f813dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 -- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b5d70 msgr2=0x7f82f80b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f6ffd640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b5d70 0x7f82f80b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b5d70 0x7f82f80b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 -- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82f813f050 msgr2=0x7f82f813dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82f813f050 0x7f82f813dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 -- 172.21.15.40:0/4003592323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80b6ed0 con 0x7f82f80b2c50 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82f77fe640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82e801a040 tx=0x7f82e80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80bc420 con 0x7f82f80b2c50 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80bc5e0 con 0x7f82f80b2c50 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f80b9230 con 0x7f82f80b2c50 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80bc9d0 con 0x7f82f80b2c50 2024-05-12T22:52:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f813e780 con 0x7f82f80b2c50 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.719+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f8068330 con 0x7f82f80b2c50 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.723+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82e80c3060 con 0x7f82f80b2c50 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.723+0000 7f82dffff640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.723+0000 7f82f6ffd640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.723+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f82e811fcb0 con 0x7f82f80b2c50 2024-05-12T22:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.723+0000 7f82f6ffd640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 0x7f82e4069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82f813b170 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.727+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f82e8016090 con 0x7f82f80b2c50 2024-05-12T22:52:37.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.915+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82f8072410 con 0x7f82f80b2c50 2024-05-12T22:52:37.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.915+0000 7f82dffff640 1 -- 172.21.15.40:0/4003592323 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7f82e80f09a0 con 0x7f82f80b2c50 2024-05-12T22:52:37.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:37.917 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:52:37.918 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 msgr2=0x7f82e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 0x7f82e4069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82f813b170 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 msgr2=0x7f82f813cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82e801a040 tx=0x7f82e80191b0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 shutdown_connections 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f82e40678c0 0x7f82e4069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82f813f050 0x7f82f813dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82f80b5d70 0x7f82f80b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 --2- 172.21.15.40:0/4003592323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82f80b2c50 0x7f82f813cde0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:37.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 >> 172.21.15.40:0/4003592323 conn(0x7f82f806b6c0 msgr2=0x7f82f8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:37.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 shutdown_connections 2024-05-12T22:52:37.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:37.919+0000 7f82fe019640 1 -- 172.21.15.40:0/4003592323 wait complete. 2024-05-12T22:52:37.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.043+0000 7f8e18086640 1 Processor -- start 2024-05-12T22:52:38.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.043+0000 7f8e18086640 1 -- start start 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e18086640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8e100b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e18086640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e100b3130 con 0x7f8e100b5180 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e18086640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1014ee70 con 0x7f8e100b4d20 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e18086640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8e101493b0 con 0x7f8e100b1230 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e16623640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8e100b5180 0x7f8e101561a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33584/0 (socket says 172.21.15.40:33584) 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e16623640 1 -- 172.21.15.40:0/3732937754 learned_addr learned my addr 172.21.15.40:0/3732937754 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8e100b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066899763 0 0) 0x7f8e100b3130 con 0x7f8e100b5180 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df8003530 con 0x7f8e100b5180 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1084063280 0 0) 0x7f8df8003530 con 0x7f8e100b5180 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 msgr2=0x7f8e100b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8e100b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 >> v1:172.21.15.47:6789/0 conn(0x7f8e100b4d20 legacy=0x7f8e1014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e100b1610 con 0x7f8e100b5180 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f8e08001680 con 0x7f8e100b5180 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 >> v1:172.21.15.40:6789/0 conn(0x7f8e100b5180 legacy=0x7f8e101561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df80039f0 0x7f8df8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8df8004810 0x7f8df8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8df80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101493b0 con 0x7f8df80039f0 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8df800ba80 con 0x7f8df8004810 2024-05-12T22:52:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8df800bc80 con 0x7f8e100b1230 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df80039f0 0x7f8df8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e16623640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8df80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15621640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8df8004810 0x7f8df8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 -- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 msgr2=0x7f8df80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8e100b1230 0x7f8df80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 -- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8df8004810 msgr2=0x7f8df8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8df8004810 0x7f8df8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15e22640 1 -- 172.21.15.40:0/3732937754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df8003530 con 0x7f8df80039f0 2024-05-12T22:52:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.047+0000 7f8e15621640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8df8004810 0x7f8df8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e15e22640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df80039f0 0x7f8df8003e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009ab0 tx=0x7f8e0001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6285ea4903d035 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e000096b0 con 0x7f8df80039f0 2024-05-12T22:52:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e000a6410 con 0x7f8df80039f0 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e14e20640 1 -- 172.21.15.40:0/3732937754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e000a6800 con 0x7f8df80039f0 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- 172.21.15.40:0/3732937754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df80039f0 msgr2=0x7f8df8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 --2- 172.21.15.40:0/3732937754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df80039f0 0x7f8df8003e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009ab0 tx=0x7f8e0001ca30 comp rx=0 tx=0).stop 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 -- 172.21.15.40:0/3732937754 reap_dead start 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- 172.21.15.40:0/3732937754 shutdown_connections 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- 172.21.15.40:0/3732937754 >> 172.21.15.40:0/3732937754 conn(0x7f8e1006b6c0 msgr2=0x7f8e1006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- 172.21.15.40:0/3732937754 shutdown_connections 2024-05-12T22:52:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- 172.21.15.40:0/3732937754 wait complete. 2024-05-12T22:52:38.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 Processor -- start 2024-05-12T22:52:38.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- start start 2024-05-12T22:52:38.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8df80039f0 0x7f8e101e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 0x7f8e1006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1014fce0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e100b0b80 con 0x7f8e100b81d0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e18086640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8e100b0110 con 0x7f8df80039f0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59316/0 (socket says 172.21.15.40:59316) 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 -- 172.21.15.40:0/23823871 learned_addr learned my addr 172.21.15.40:0/23823871 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e15e22640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8df80039f0 0x7f8e101e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e15621640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 0x7f8e1006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 -- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8df80039f0 msgr2=0x7f8e101e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8df80039f0 0x7f8e101e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 -- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 msgr2=0x7f8e1006f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 0x7f8e1006f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e16623640 1 -- 172.21.15.40:0/23823871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10153490 con 0x7f8e1006f8a0 2024-05-12T22:52:38.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.051+0000 7f8e15621640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 0x7f8e1006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e16623640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e100b5560 tx=0x7f8e0800d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e080074e0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e080047f0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007680 con 0x7f8e1006f8a0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e100b8c90 con 0x7f8e1006f8a0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101e76e0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e10068330 con 0x7f8e1006f8a0 2024-05-12T22:52:38.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e08004be0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 0x7f8dfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e08085950 con 0x7f8e1006f8a0 2024-05-12T22:52:38.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e15e22640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 0x7f8dfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.055+0000 7f8e15e22640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 0x7f8dfc069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e000ad000 tx=0x7f8e000a9040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.059+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8e08056480 con 0x7f8e1006f8a0 2024-05-12T22:52:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.215+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e100b85b0 con 0x7f8e1006f8a0 2024-05-12T22:52:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.215+0000 7f8e0e7fc640 1 -- 172.21.15.40:0/23823871 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7f8e08055d80 con 0x7f8e1006f8a0 2024-05-12T22:52:38.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:38.217 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 msgr2=0x7f8dfc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 0x7f8dfc069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e000ad000 tx=0x7f8e000a9040 comp rx=0 tx=0).stop 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 msgr2=0x7f8e1006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e100b5560 tx=0x7f8e0800d900 comp rx=0 tx=0).stop 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 shutdown_connections 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1006f8a0 0x7f8e1006fd20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8dfc0678f0 0x7f8dfc069db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e100b81d0 0x7f8e1006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 --2- 172.21.15.40:0/23823871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8df80039f0 0x7f8e101e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 >> 172.21.15.40:0/23823871 conn(0x7f8e1006b6c0 msgr2=0x7f8e1014c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 shutdown_connections 2024-05-12T22:52:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.219+0000 7f8e18086640 1 -- 172.21.15.40:0/23823871 wait complete. 2024-05-12T22:52:38.234 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-12T22:52:38.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.343+0000 7ff8762d4640 1 Processor -- start 2024-05-12T22:52:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.343+0000 7ff8762d4640 1 -- start start 2024-05-12T22:52:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff87013f760 0x7ff870150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8700b6150 con 0x7ff8700b5d70 2024-05-12T22:52:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87006f620 con 0x7ff870149070 2024-05-12T22:52:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff87006f990 con 0x7ff87013f760 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff87013f760 0x7ff870150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff87013f760 0x7ff870150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59332/0 (socket says 172.21.15.40:59332) 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 -- 172.21.15.40:0/1489557450 learned_addr learned my addr 172.21.15.40:0/1489557450 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 -- 172.21.15.40:0/1489557450 >> v1:172.21.15.47:6789/0 conn(0x7ff870149070 legacy=0x7ff87013f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 -- 172.21.15.40:0/1489557450 >> v1:172.21.15.40:6789/0 conn(0x7ff8700b5d70 legacy=0x7ff870148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 -- 172.21.15.40:0/1489557450 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8700b4ea0 con 0x7ff87013f760 2024-05-12T22:52:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff874871640 1 --2- 172.21.15.40:0/1489557450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff870150b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff868009e50 tx=0x7ff86801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fc371ed51f42ca server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff86effd640 1 -- 172.21.15.40:0/1489557450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8680a5840 con 0x7ff87013f760 2024-05-12T22:52:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff86effd640 1 -- 172.21.15.40:0/1489557450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8680a59e0 con 0x7ff87013f760 2024-05-12T22:52:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff86effd640 1 -- 172.21.15.40:0/1489557450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8680a5db0 con 0x7ff87013f760 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- 172.21.15.40:0/1489557450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 msgr2=0x7ff870150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 --2- 172.21.15.40:0/1489557450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff870150b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff868009e50 tx=0x7ff86801c960 comp rx=0 tx=0).stop 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- 172.21.15.40:0/1489557450 shutdown_connections 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 --2- 172.21.15.40:0/1489557450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff870150b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- 172.21.15.40:0/1489557450 >> 172.21.15.40:0/1489557450 conn(0x7ff87006b6c0 msgr2=0x7ff87006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- 172.21.15.40:0/1489557450 shutdown_connections 2024-05-12T22:52:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.347+0000 7ff8762d4640 1 -- 172.21.15.40:0/1489557450 wait complete. 2024-05-12T22:52:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 Processor -- start 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- start start 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 0x7ff87013d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff870149070 0x7ff8701e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff870153ac0 con 0x7ff87013f760 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8700708b0 con 0x7ff8700b5d70 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff870153c40 con 0x7ff870149070 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59344/0 (socket says 172.21.15.40:59344) 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 -- 172.21.15.40:0/4024050898 learned_addr learned my addr 172.21.15.40:0/4024050898 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86ffff640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 0x7ff87013d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff874871640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff870149070 0x7ff8701e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 -- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff870149070 msgr2=0x7ff8701e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff870149070 0x7ff8701e0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 -- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 msgr2=0x7ff87013d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 0x7ff87013d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 -- 172.21.15.40:0/4024050898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8701dfe50 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86ffff640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 0x7ff87013d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86f7fe640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff86000b410 tx=0x7ff86000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860015030 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff860004020 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8700b1520 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860004410 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87013e960 con 0x7ff87013f760 2024-05-12T22:52:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff870068330 con 0x7ff87013f760 2024-05-12T22:52:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff860018070 con 0x7ff87013f760 2024-05-12T22:52:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.351+0000 7ff86cff9640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 0x7ff85c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.355+0000 7ff86ffff640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 0x7ff85c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.355+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff860085700 con 0x7ff87013f760 2024-05-12T22:52:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.355+0000 7ff86ffff640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 0x7ff85c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8640016f0 tx=0x7ff864009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.359+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff8600562d0 con 0x7ff87013f760 2024-05-12T22:52:38.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.507+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8700b1240 con 0x7ff85c0678c0 2024-05-12T22:52:38.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.527+0000 7ff86cff9640 1 -- 172.21.15.40:0/4024050898 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244115 (secure 0 0 0) 0x7ff8700b1240 con 0x7ff85c0678c0 2024-05-12T22:52:38.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:38.549 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:38.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 msgr2=0x7ff85c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 0x7ff85c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8640016f0 tx=0x7ff864009040 comp rx=0 tx=0).stop 2024-05-12T22:52:38.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 msgr2=0x7ff8700b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff86000b410 tx=0x7ff86000b8d0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 shutdown_connections 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff870149070 0x7ff8701e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff87013f760 0x7ff8700b1ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff85c0678c0 0x7ff85c069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 --2- 172.21.15.40:0/4024050898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8700b5d70 0x7ff87013d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 >> 172.21.15.40:0/4024050898 conn(0x7ff87006b6c0 msgr2=0x7ff8700b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 shutdown_connections 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.531+0000 7ff8762d4640 1 -- 172.21.15.40:0/4024050898 wait complete. 2024-05-12T22:52:38.557 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-12T22:52:37.345976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234384,"kb_used_data":1528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740336,"statfs":{"total":773094113280,"available":772854104064,"internally_reserved":0,"allocated":1564672,"data_stored":1629699,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556482+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:35.556482+0000","last_peered":"2024-05-12T22:52:35.556482+0000","last_clean":"2024-05-12T22:52:35.556482+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:35.556482+0000","last_undegraded":"2024-05-12T22:52:35.556482+0000","last_fullsized":"2024-05-12T22:52:35.556482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549705+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:35.549705+0000","last_peered":"2024-05-12T22:52:35.549705+0000","last_clean":"2024-05-12T22:52:35.549705+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:35.549705+0000","last_undegraded":"2024-05-12T22:52:35.549705+0000","last_fullsized":"2024-05-12T22:52:35.549705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:12:14.221710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574134+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:35.574134+0000","last_peered":"2024-05-12T22:52:35.574134+0000","last_clean":"2024-05-12T22:52:35.574134+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:35.574134+0000","last_undegraded":"2024-05-12T22:52:35.574134+0000","last_fullsized":"2024-05-12T22:52:35.574134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:24:44.471953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553634+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:35.553634+0000","last_peered":"2024-05-12T22:52:35.553634+0000","last_clean":"2024-05-12T22:52:35.553634+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:35.553634+0000","last_undegraded":"2024-05-12T22:52:35.553634+0000","last_fullsized":"2024-05-12T22:52:35.553634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553951+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:35.553951+0000","last_peered":"2024-05-12T22:52:35.553951+0000","last_clean":"2024-05-12T22:52:35.553951+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:35.553951+0000","last_undegraded":"2024-05-12T22:52:35.553951+0000","last_fullsized":"2024-05-12T22:52:35.553951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:10.856297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586648+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:35.586648+0000","last_peered":"2024-05-12T22:52:35.586648+0000","last_clean":"2024-05-12T22:52:35.586648+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:35.586648+0000","last_undegraded":"2024-05-12T22:52:35.586648+0000","last_fullsized":"2024-05-12T22:52:35.586648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565676+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:35.565676+0000","last_peered":"2024-05-12T22:52:35.565676+0000","last_clean":"2024-05-12T22:52:35.565676+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:35.565676+0000","last_undegraded":"2024-05-12T22:52:35.565676+0000","last_fullsized":"2024-05-12T22:52:35.565676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.587083+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:35.587083+0000","last_peered":"2024-05-12T22:52:35.587083+0000","last_clean":"2024-05-12T22:52:35.587083+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:35.587083+0000","last_undegraded":"2024-05-12T22:52:35.587083+0000","last_fullsized":"2024-05-12T22:52:35.587083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586569+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:35.586569+0000","last_peered":"2024-05-12T22:52:35.586569+0000","last_clean":"2024-05-12T22:52:35.586569+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:35.586569+0000","last_undegraded":"2024-05-12T22:52:35.586569+0000","last_fullsized":"2024-05-12T22:52:35.586569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:21:45.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581842+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:35.581842+0000","last_peered":"2024-05-12T22:52:35.581842+0000","last_clean":"2024-05-12T22:52:35.581842+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:35.581842+0000","last_undegraded":"2024-05-12T22:52:35.581842+0000","last_fullsized":"2024-05-12T22:52:35.581842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:14.906365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553690+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:35.553690+0000","last_peered":"2024-05-12T22:52:35.553690+0000","last_clean":"2024-05-12T22:52:35.553690+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:35.553690+0000","last_undegraded":"2024-05-12T22:52:35.553690+0000","last_fullsized":"2024-05-12T22:52:35.553690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.592261+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:35.592261+0000","last_peered":"2024-05-12T22:52:35.592261+0000","last_clean":"2024-05-12T22:52:35.592261+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:35.592261+0000","last_undegraded":"2024-05-12T22:52:35.592261+0000","last_fullsized":"2024-05-12T22:52:35.592261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:30:18.683890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.552631+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:35.552631+0000","last_peered":"2024-05-12T22:52:35.552631+0000","last_clean":"2024-05-12T22:52:35.552631+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:35.552631+0000","last_undegraded":"2024-05-12T22:52:35.552631+0000","last_fullsized":"2024-05-12T22:52:35.552631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:16.324485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.568621+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:35.568621+0000","last_peered":"2024-05-12T22:52:35.568621+0000","last_clean":"2024-05-12T22:52:35.568621+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:35.568621+0000","last_undegraded":"2024-05-12T22:52:35.568621+0000","last_fullsized":"2024-05-12T22:52:35.568621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549952+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:35.549952+0000","last_peered":"2024-05-12T22:52:35.549952+0000","last_clean":"2024-05-12T22:52:35.549952+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:35.549952+0000","last_undegraded":"2024-05-12T22:52:35.549952+0000","last_fullsized":"2024-05-12T22:52:35.549952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:39.594007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.533656+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:35.533656+0000","last_peered":"2024-05-12T22:52:35.533656+0000","last_clean":"2024-05-12T22:52:35.533656+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:35.533656+0000","last_undegraded":"2024-05-12T22:52:35.533656+0000","last_fullsized":"2024-05-12T22:52:35.533656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553112+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:35.553112+0000","last_peered":"2024-05-12T22:52:35.553112+0000","last_clean":"2024-05-12T22:52:35.553112+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:35.553112+0000","last_undegraded":"2024-05-12T22:52:35.553112+0000","last_fullsized":"2024-05-12T22:52:35.553112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:40.158701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556318+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:35.556318+0000","last_peered":"2024-05-12T22:52:35.556318+0000","last_clean":"2024-05-12T22:52:35.556318+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:35.556318+0000","last_undegraded":"2024-05-12T22:52:35.556318+0000","last_fullsized":"2024-05-12T22:52:35.556318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561149+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:35.561149+0000","last_peered":"2024-05-12T22:52:35.561149+0000","last_clean":"2024-05-12T22:52:35.561149+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:35.561149+0000","last_undegraded":"2024-05-12T22:52:35.561149+0000","last_fullsized":"2024-05-12T22:52:35.561149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565291+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:35.565291+0000","last_peered":"2024-05-12T22:52:35.565291+0000","last_clean":"2024-05-12T22:52:35.565291+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:35.565291+0000","last_undegraded":"2024-05-12T22:52:35.565291+0000","last_fullsized":"2024-05-12T22:52:35.565291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.596836+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:35.596836+0000","last_peered":"2024-05-12T22:52:35.596836+0000","last_clean":"2024-05-12T22:52:35.596836+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:35.596836+0000","last_undegraded":"2024-05-12T22:52:35.596836+0000","last_fullsized":"2024-05-12T22:52:35.596836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.569090+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:35.569090+0000","last_peered":"2024-05-12T22:52:35.569090+0000","last_clean":"2024-05-12T22:52:35.569090+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:35.569090+0000","last_undegraded":"2024-05-12T22:52:35.569090+0000","last_fullsized":"2024-05-12T22:52:35.569090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.557202+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:35.557202+0000","last_peered":"2024-05-12T22:52:35.557202+0000","last_clean":"2024-05-12T22:52:35.557202+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:35.557202+0000","last_undegraded":"2024-05-12T22:52:35.557202+0000","last_fullsized":"2024-05-12T22:52:35.557202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.548001+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:35.548001+0000","last_peered":"2024-05-12T22:52:35.548001+0000","last_clean":"2024-05-12T22:52:35.548001+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:35.548001+0000","last_undegraded":"2024-05-12T22:52:35.548001+0000","last_fullsized":"2024-05-12T22:52:35.548001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.585239+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:35.585239+0000","last_peered":"2024-05-12T22:52:35.585239+0000","last_clean":"2024-05-12T22:52:35.585239+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:35.585239+0000","last_undegraded":"2024-05-12T22:52:35.585239+0000","last_fullsized":"2024-05-12T22:52:35.585239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538480+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:35.538480+0000","last_peered":"2024-05-12T22:52:35.538480+0000","last_clean":"2024-05-12T22:52:35.538480+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:35.538480+0000","last_undegraded":"2024-05-12T22:52:35.538480+0000","last_fullsized":"2024-05-12T22:52:35.538480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-12T22:52:24.501825+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:24.501825+0000","last_peered":"2024-05-12T22:52:24.501825+0000","last_clean":"2024-05-12T22:52:24.501825+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:24.501825+0000","last_undegraded":"2024-05-12T22:52:24.501825+0000","last_fullsized":"2024-05-12T22:52:24.501825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574083+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:35.574083+0000","last_peered":"2024-05-12T22:52:35.574083+0000","last_clean":"2024-05-12T22:52:35.574083+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:35.574083+0000","last_undegraded":"2024-05-12T22:52:35.574083+0000","last_fullsized":"2024-05-12T22:52:35.574083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:04.940250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538202+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:35.538202+0000","last_peered":"2024-05-12T22:52:35.538202+0000","last_clean":"2024-05-12T22:52:35.538202+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:35.538202+0000","last_undegraded":"2024-05-12T22:52:35.538202+0000","last_fullsized":"2024-05-12T22:52:35.538202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558867+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:35.558867+0000","last_peered":"2024-05-12T22:52:35.558867+0000","last_clean":"2024-05-12T22:52:35.558867+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:35.558867+0000","last_undegraded":"2024-05-12T22:52:35.558867+0000","last_fullsized":"2024-05-12T22:52:35.558867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537595+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:35.537595+0000","last_peered":"2024-05-12T22:52:35.537595+0000","last_clean":"2024-05-12T22:52:35.537595+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:35.537595+0000","last_undegraded":"2024-05-12T22:52:35.537595+0000","last_fullsized":"2024-05-12T22:52:35.537595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556448+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:35.556448+0000","last_peered":"2024-05-12T22:52:35.556448+0000","last_clean":"2024-05-12T22:52:35.556448+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:35.556448+0000","last_undegraded":"2024-05-12T22:52:35.556448+0000","last_fullsized":"2024-05-12T22:52:35.556448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537353+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:35.537353+0000","last_peered":"2024-05-12T22:52:35.537353+0000","last_clean":"2024-05-12T22:52:35.537353+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:35.537353+0000","last_undegraded":"2024-05-12T22:52:35.537353+0000","last_fullsized":"2024-05-12T22:52:35.537353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.576833+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:35.576833+0000","last_peered":"2024-05-12T22:52:35.576833+0000","last_clean":"2024-05-12T22:52:35.576833+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:35.576833+0000","last_undegraded":"2024-05-12T22:52:35.576833+0000","last_fullsized":"2024-05-12T22:52:35.576833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:04:00.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553977+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:35.553977+0000","last_peered":"2024-05-12T22:52:35.553977+0000","last_clean":"2024-05-12T22:52:35.553977+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:35.553977+0000","last_undegraded":"2024-05-12T22:52:35.553977+0000","last_fullsized":"2024-05-12T22:52:35.553977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:14.936593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537146+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:35.537146+0000","last_peered":"2024-05-12T22:52:35.537146+0000","last_clean":"2024-05-12T22:52:35.537146+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:35.537146+0000","last_undegraded":"2024-05-12T22:52:35.537146+0000","last_fullsized":"2024-05-12T22:52:35.537146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558133+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:35.558133+0000","last_peered":"2024-05-12T22:52:35.558133+0000","last_clean":"2024-05-12T22:52:35.558133+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:35.558133+0000","last_undegraded":"2024-05-12T22:52:35.558133+0000","last_fullsized":"2024-05-12T22:52:35.558133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537529+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:35.537529+0000","last_peered":"2024-05-12T22:52:35.537529+0000","last_clean":"2024-05-12T22:52:35.537529+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:35.537529+0000","last_undegraded":"2024-05-12T22:52:35.537529+0000","last_fullsized":"2024-05-12T22:52:35.537529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.555615+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:35.555615+0000","last_peered":"2024-05-12T22:52:35.555615+0000","last_clean":"2024-05-12T22:52:35.555615+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:35.555615+0000","last_undegraded":"2024-05-12T22:52:35.555615+0000","last_fullsized":"2024-05-12T22:52:35.555615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561135+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:35.561135+0000","last_peered":"2024-05-12T22:52:35.561135+0000","last_clean":"2024-05-12T22:52:35.561135+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:35.561135+0000","last_undegraded":"2024-05-12T22:52:35.561135+0000","last_fullsized":"2024-05-12T22:52:35.561135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:47.873600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.551566+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:35.551566+0000","last_peered":"2024-05-12T22:52:35.551566+0000","last_clean":"2024-05-12T22:52:35.551566+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:35.551566+0000","last_undegraded":"2024-05-12T22:52:35.551566+0000","last_fullsized":"2024-05-12T22:52:35.551566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.560815+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:35.560815+0000","last_peered":"2024-05-12T22:52:35.560815+0000","last_clean":"2024-05-12T22:52:35.560815+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:35.560815+0000","last_undegraded":"2024-05-12T22:52:35.560815+0000","last_fullsized":"2024-05-12T22:52:35.560815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.591745+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:35.591745+0000","last_peered":"2024-05-12T22:52:35.591745+0000","last_clean":"2024-05-12T22:52:35.591745+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:35.591745+0000","last_undegraded":"2024-05-12T22:52:35.591745+0000","last_fullsized":"2024-05-12T22:52:35.591745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":225280,"data_stored":637802,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":657307,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:38.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.687+0000 7f3a03765640 1 Processor -- start 2024-05-12T22:52:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a03765640 1 -- start start 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a03765640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39fc0bd760 0x7f39fc1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a03765640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0bdb40 con 0x7f39fc14b210 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a03765640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc0b4580 con 0x7f39fc0b5b70 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a03765640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc0b6ef0 con 0x7f39fc0bd760 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01d02640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f39fc14b210 0x7f39fc151e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33596/0 (socket says 172.21.15.40:33596) 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01d02640 1 -- 172.21.15.40:0/1742469296 learned_addr learned my addr 172.21.15.40:0/1742469296 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 --2- 172.21.15.40:0/1742469296 >> v2:172.21.15.47:3300/0 conn(0x7f39fc0bd760 0x7f39fc1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432507941 0 0) 0x7f39fc0bdb40 con 0x7f39fc14b210 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e8003530 con 0x7f39fc14b210 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1340293165 0 0) 0x7f39e8003530 con 0x7f39fc14b210 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 >> v2:172.21.15.47:3300/0 conn(0x7f39fc0bd760 msgr2=0x7f39fc1410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 --2- 172.21.15.40:0/1742469296 >> v2:172.21.15.47:3300/0 conn(0x7f39fc0bd760 0x7f39fc1410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 >> v1:172.21.15.47:6789/0 conn(0x7f39fc0b5b70 legacy=0x7f39fc14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc0b4860 con 0x7f39fc14b210 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f39f4001a00 con 0x7f39fc14b210 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 >> v1:172.21.15.40:6789/0 conn(0x7f39fc14b210 legacy=0x7f39fc151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b6ef0 con 0x7f39e80039c0 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39e800c170 con 0x7f39e80051d0 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f39e800c370 con 0x7f39e8004810 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01d02640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a00d00640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 -- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39e8004810 msgr2=0x7f39e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 -- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80051d0 msgr2=0x7f39e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:38.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01501640 1 -- 172.21.15.40:0/1742469296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e8003530 con 0x7f39e80039c0 2024-05-12T22:52:38.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.691+0000 7f3a01d02640 1 -- 172.21.15.40:0/1742469296 reap_dead start 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a01501640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142bcffd40192e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80096b0 con 0x7f39e80039c0 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f80a6450 con 0x7f39e80039c0 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f39f3fff640 1 -- 172.21.15.40:0/1742469296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80a6840 con 0x7f39e80039c0 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 msgr2=0x7f39e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f801ca70 comp rx=0 tx=0).stop 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- 172.21.15.40:0/1742469296 shutdown_connections 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 --2- 172.21.15.40:0/1742469296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- 172.21.15.40:0/1742469296 >> 172.21.15.40:0/1742469296 conn(0x7f39fc072ff0 msgr2=0x7f39fc0bcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- 172.21.15.40:0/1742469296 shutdown_connections 2024-05-12T22:52:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- 172.21.15.40:0/1742469296 wait complete. 2024-05-12T22:52:38.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 Processor -- start 2024-05-12T22:52:38.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- start start 2024-05-12T22:52:38.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 0x7f39fc1e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc1d58d0 0x7f39fc1d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b7770 con 0x7f39fc142ff0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b78f0 con 0x7f39e80039c0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a03765640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0b7a70 con 0x7f39fc1d58d0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59356/0 (socket says 172.21.15.40:59356) 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 -- 172.21.15.40:0/1873559829 learned_addr learned my addr 172.21.15.40:0/1873559829 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a01d02640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc1d58d0 0x7f39fc1d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a01501640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 0x7f39fc1e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 -- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc1d58d0 msgr2=0x7f39fc1d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc1d58d0 0x7f39fc1d5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 -- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 msgr2=0x7f39fc1e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 0x7f39fc1e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 -- 172.21.15.40:0/1873559829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc1d30b0 con 0x7f39fc142ff0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a01501640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 0x7f39fc1e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.695+0000 7f3a00d00640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d4d0 tx=0x7f39ec00d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec005480 con 0x7f39fc142ff0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec017070 con 0x7f39fc142ff0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec003820 con 0x7f39fc142ff0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc1e3b00 con 0x7f39fc142ff0 2024-05-12T22:52:38.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc141e90 con 0x7f39fc142ff0 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc068a40 con 0x7f39fc142ff0 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39ec0039c0 con 0x7f39fc142ff0 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 0x7f39e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39ec085860 con 0x7f39fc142ff0 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f3a01501640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 0x7f39e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:38.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.699+0000 7f3a01501640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 0x7f39e0069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39f80ad000 tx=0x7f39f80a9040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:38.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.703+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f39ec056430 con 0x7f39fc142ff0 2024-05-12T22:52:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.863+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39fc149d10 con 0x7f39e00678c0 2024-05-12T22:52:38.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.875+0000 7f39f1ffb640 1 -- 172.21.15.40:0/1873559829 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244115 (secure 0 0 0) 0x7f39fc149d10 con 0x7f39e00678c0 2024-05-12T22:52:38.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:38.879 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 msgr2=0x7f39e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 0x7f39e0069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39f80ad000 tx=0x7f39f80a9040 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 msgr2=0x7f39fc1e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d4d0 tx=0x7f39ec00d990 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 shutdown_connections 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f39fc1d58d0 0x7f39fc1d5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39fc142ff0 0x7f39fc1e04f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f39e00678c0 0x7f39e0069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 --2- 172.21.15.40:0/1873559829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e80039c0 0x7f39fc1e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 >> 172.21.15.40:0/1873559829 conn(0x7f39fc072ff0 msgr2=0x7f39fc147920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 shutdown_connections 2024-05-12T22:52:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:38.879+0000 7f3a03765640 1 -- 172.21.15.40:0/1873559829 wait complete. 2024-05-12T22:52:38.897 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-12T22:52:37.345976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234384,"kb_used_data":1528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740336,"statfs":{"total":773094113280,"available":772854104064,"internally_reserved":0,"allocated":1564672,"data_stored":1629699,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556482+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:35.556482+0000","last_peered":"2024-05-12T22:52:35.556482+0000","last_clean":"2024-05-12T22:52:35.556482+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:35.556482+0000","last_undegraded":"2024-05-12T22:52:35.556482+0000","last_fullsized":"2024-05-12T22:52:35.556482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549705+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:35.549705+0000","last_peered":"2024-05-12T22:52:35.549705+0000","last_clean":"2024-05-12T22:52:35.549705+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:35.549705+0000","last_undegraded":"2024-05-12T22:52:35.549705+0000","last_fullsized":"2024-05-12T22:52:35.549705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:12:14.221710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574134+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:35.574134+0000","last_peered":"2024-05-12T22:52:35.574134+0000","last_clean":"2024-05-12T22:52:35.574134+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:35.574134+0000","last_undegraded":"2024-05-12T22:52:35.574134+0000","last_fullsized":"2024-05-12T22:52:35.574134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:24:44.471953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553634+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:35.553634+0000","last_peered":"2024-05-12T22:52:35.553634+0000","last_clean":"2024-05-12T22:52:35.553634+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:35.553634+0000","last_undegraded":"2024-05-12T22:52:35.553634+0000","last_fullsized":"2024-05-12T22:52:35.553634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553951+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:35.553951+0000","last_peered":"2024-05-12T22:52:35.553951+0000","last_clean":"2024-05-12T22:52:35.553951+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:35.553951+0000","last_undegraded":"2024-05-12T22:52:35.553951+0000","last_fullsized":"2024-05-12T22:52:35.553951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:10.856297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586648+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:35.586648+0000","last_peered":"2024-05-12T22:52:35.586648+0000","last_clean":"2024-05-12T22:52:35.586648+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:35.586648+0000","last_undegraded":"2024-05-12T22:52:35.586648+0000","last_fullsized":"2024-05-12T22:52:35.586648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565676+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:35.565676+0000","last_peered":"2024-05-12T22:52:35.565676+0000","last_clean":"2024-05-12T22:52:35.565676+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:35.565676+0000","last_undegraded":"2024-05-12T22:52:35.565676+0000","last_fullsized":"2024-05-12T22:52:35.565676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.587083+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:35.587083+0000","last_peered":"2024-05-12T22:52:35.587083+0000","last_clean":"2024-05-12T22:52:35.587083+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:35.587083+0000","last_undegraded":"2024-05-12T22:52:35.587083+0000","last_fullsized":"2024-05-12T22:52:35.587083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586569+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:35.586569+0000","last_peered":"2024-05-12T22:52:35.586569+0000","last_clean":"2024-05-12T22:52:35.586569+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:35.586569+0000","last_undegraded":"2024-05-12T22:52:35.586569+0000","last_fullsized":"2024-05-12T22:52:35.586569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:21:45.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581842+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:35.581842+0000","last_peered":"2024-05-12T22:52:35.581842+0000","last_clean":"2024-05-12T22:52:35.581842+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:35.581842+0000","last_undegraded":"2024-05-12T22:52:35.581842+0000","last_fullsized":"2024-05-12T22:52:35.581842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:14.906365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553690+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:35.553690+0000","last_peered":"2024-05-12T22:52:35.553690+0000","last_clean":"2024-05-12T22:52:35.553690+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:35.553690+0000","last_undegraded":"2024-05-12T22:52:35.553690+0000","last_fullsized":"2024-05-12T22:52:35.553690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.592261+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:35.592261+0000","last_peered":"2024-05-12T22:52:35.592261+0000","last_clean":"2024-05-12T22:52:35.592261+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:35.592261+0000","last_undegraded":"2024-05-12T22:52:35.592261+0000","last_fullsized":"2024-05-12T22:52:35.592261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:30:18.683890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.552631+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:35.552631+0000","last_peered":"2024-05-12T22:52:35.552631+0000","last_clean":"2024-05-12T22:52:35.552631+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:35.552631+0000","last_undegraded":"2024-05-12T22:52:35.552631+0000","last_fullsized":"2024-05-12T22:52:35.552631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:16.324485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.568621+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:35.568621+0000","last_peered":"2024-05-12T22:52:35.568621+0000","last_clean":"2024-05-12T22:52:35.568621+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:35.568621+0000","last_undegraded":"2024-05-12T22:52:35.568621+0000","last_fullsized":"2024-05-12T22:52:35.568621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549952+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:35.549952+0000","last_peered":"2024-05-12T22:52:35.549952+0000","last_clean":"2024-05-12T22:52:35.549952+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:35.549952+0000","last_undegraded":"2024-05-12T22:52:35.549952+0000","last_fullsized":"2024-05-12T22:52:35.549952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:39.594007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.533656+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:35.533656+0000","last_peered":"2024-05-12T22:52:35.533656+0000","last_clean":"2024-05-12T22:52:35.533656+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:35.533656+0000","last_undegraded":"2024-05-12T22:52:35.533656+0000","last_fullsized":"2024-05-12T22:52:35.533656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553112+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:35.553112+0000","last_peered":"2024-05-12T22:52:35.553112+0000","last_clean":"2024-05-12T22:52:35.553112+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:35.553112+0000","last_undegraded":"2024-05-12T22:52:35.553112+0000","last_fullsized":"2024-05-12T22:52:35.553112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:40.158701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556318+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:35.556318+0000","last_peered":"2024-05-12T22:52:35.556318+0000","last_clean":"2024-05-12T22:52:35.556318+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:35.556318+0000","last_undegraded":"2024-05-12T22:52:35.556318+0000","last_fullsized":"2024-05-12T22:52:35.556318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561149+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:35.561149+0000","last_peered":"2024-05-12T22:52:35.561149+0000","last_clean":"2024-05-12T22:52:35.561149+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:35.561149+0000","last_undegraded":"2024-05-12T22:52:35.561149+0000","last_fullsized":"2024-05-12T22:52:35.561149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565291+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:35.565291+0000","last_peered":"2024-05-12T22:52:35.565291+0000","last_clean":"2024-05-12T22:52:35.565291+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:35.565291+0000","last_undegraded":"2024-05-12T22:52:35.565291+0000","last_fullsized":"2024-05-12T22:52:35.565291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.596836+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:35.596836+0000","last_peered":"2024-05-12T22:52:35.596836+0000","last_clean":"2024-05-12T22:52:35.596836+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:35.596836+0000","last_undegraded":"2024-05-12T22:52:35.596836+0000","last_fullsized":"2024-05-12T22:52:35.596836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.569090+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:35.569090+0000","last_peered":"2024-05-12T22:52:35.569090+0000","last_clean":"2024-05-12T22:52:35.569090+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:35.569090+0000","last_undegraded":"2024-05-12T22:52:35.569090+0000","last_fullsized":"2024-05-12T22:52:35.569090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.557202+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:35.557202+0000","last_peered":"2024-05-12T22:52:35.557202+0000","last_clean":"2024-05-12T22:52:35.557202+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:35.557202+0000","last_undegraded":"2024-05-12T22:52:35.557202+0000","last_fullsized":"2024-05-12T22:52:35.557202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.548001+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:35.548001+0000","last_peered":"2024-05-12T22:52:35.548001+0000","last_clean":"2024-05-12T22:52:35.548001+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:35.548001+0000","last_undegraded":"2024-05-12T22:52:35.548001+0000","last_fullsized":"2024-05-12T22:52:35.548001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.585239+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:35.585239+0000","last_peered":"2024-05-12T22:52:35.585239+0000","last_clean":"2024-05-12T22:52:35.585239+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:35.585239+0000","last_undegraded":"2024-05-12T22:52:35.585239+0000","last_fullsized":"2024-05-12T22:52:35.585239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538480+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:35.538480+0000","last_peered":"2024-05-12T22:52:35.538480+0000","last_clean":"2024-05-12T22:52:35.538480+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:35.538480+0000","last_undegraded":"2024-05-12T22:52:35.538480+0000","last_fullsized":"2024-05-12T22:52:35.538480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-12T22:52:24.501825+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:24.501825+0000","last_peered":"2024-05-12T22:52:24.501825+0000","last_clean":"2024-05-12T22:52:24.501825+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:24.501825+0000","last_undegraded":"2024-05-12T22:52:24.501825+0000","last_fullsized":"2024-05-12T22:52:24.501825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574083+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:35.574083+0000","last_peered":"2024-05-12T22:52:35.574083+0000","last_clean":"2024-05-12T22:52:35.574083+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:35.574083+0000","last_undegraded":"2024-05-12T22:52:35.574083+0000","last_fullsized":"2024-05-12T22:52:35.574083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:04.940250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538202+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:35.538202+0000","last_peered":"2024-05-12T22:52:35.538202+0000","last_clean":"2024-05-12T22:52:35.538202+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:35.538202+0000","last_undegraded":"2024-05-12T22:52:35.538202+0000","last_fullsized":"2024-05-12T22:52:35.538202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558867+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:35.558867+0000","last_peered":"2024-05-12T22:52:35.558867+0000","last_clean":"2024-05-12T22:52:35.558867+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:35.558867+0000","last_undegraded":"2024-05-12T22:52:35.558867+0000","last_fullsized":"2024-05-12T22:52:35.558867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537595+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:35.537595+0000","last_peered":"2024-05-12T22:52:35.537595+0000","last_clean":"2024-05-12T22:52:35.537595+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:35.537595+0000","last_undegraded":"2024-05-12T22:52:35.537595+0000","last_fullsized":"2024-05-12T22:52:35.537595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556448+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:35.556448+0000","last_peered":"2024-05-12T22:52:35.556448+0000","last_clean":"2024-05-12T22:52:35.556448+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:35.556448+0000","last_undegraded":"2024-05-12T22:52:35.556448+0000","last_fullsized":"2024-05-12T22:52:35.556448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537353+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:35.537353+0000","last_peered":"2024-05-12T22:52:35.537353+0000","last_clean":"2024-05-12T22:52:35.537353+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:35.537353+0000","last_undegraded":"2024-05-12T22:52:35.537353+0000","last_fullsized":"2024-05-12T22:52:35.537353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.576833+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:35.576833+0000","last_peered":"2024-05-12T22:52:35.576833+0000","last_clean":"2024-05-12T22:52:35.576833+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:35.576833+0000","last_undegraded":"2024-05-12T22:52:35.576833+0000","last_fullsized":"2024-05-12T22:52:35.576833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:04:00.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553977+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:35.553977+0000","last_peered":"2024-05-12T22:52:35.553977+0000","last_clean":"2024-05-12T22:52:35.553977+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:35.553977+0000","last_undegraded":"2024-05-12T22:52:35.553977+0000","last_fullsized":"2024-05-12T22:52:35.553977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:14.936593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537146+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:35.537146+0000","last_peered":"2024-05-12T22:52:35.537146+0000","last_clean":"2024-05-12T22:52:35.537146+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:35.537146+0000","last_undegraded":"2024-05-12T22:52:35.537146+0000","last_fullsized":"2024-05-12T22:52:35.537146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558133+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:35.558133+0000","last_peered":"2024-05-12T22:52:35.558133+0000","last_clean":"2024-05-12T22:52:35.558133+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:35.558133+0000","last_undegraded":"2024-05-12T22:52:35.558133+0000","last_fullsized":"2024-05-12T22:52:35.558133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537529+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:35.537529+0000","last_peered":"2024-05-12T22:52:35.537529+0000","last_clean":"2024-05-12T22:52:35.537529+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:35.537529+0000","last_undegraded":"2024-05-12T22:52:35.537529+0000","last_fullsized":"2024-05-12T22:52:35.537529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.555615+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:35.555615+0000","last_peered":"2024-05-12T22:52:35.555615+0000","last_clean":"2024-05-12T22:52:35.555615+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:35.555615+0000","last_undegraded":"2024-05-12T22:52:35.555615+0000","last_fullsized":"2024-05-12T22:52:35.555615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561135+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:35.561135+0000","last_peered":"2024-05-12T22:52:35.561135+0000","last_clean":"2024-05-12T22:52:35.561135+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:35.561135+0000","last_undegraded":"2024-05-12T22:52:35.561135+0000","last_fullsized":"2024-05-12T22:52:35.561135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:47.873600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.551566+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:35.551566+0000","last_peered":"2024-05-12T22:52:35.551566+0000","last_clean":"2024-05-12T22:52:35.551566+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:35.551566+0000","last_undegraded":"2024-05-12T22:52:35.551566+0000","last_fullsized":"2024-05-12T22:52:35.551566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.560815+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:35.560815+0000","last_peered":"2024-05-12T22:52:35.560815+0000","last_clean":"2024-05-12T22:52:35.560815+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:35.560815+0000","last_undegraded":"2024-05-12T22:52:35.560815+0000","last_fullsized":"2024-05-12T22:52:35.560815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.591745+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:35.591745+0000","last_peered":"2024-05-12T22:52:35.591745+0000","last_clean":"2024-05-12T22:52:35.591745+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:35.591745+0000","last_undegraded":"2024-05-12T22:52:35.591745+0000","last_fullsized":"2024-05-12T22:52:35.591745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":225280,"data_stored":637802,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":657307,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:38.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.059+0000 7f902cf15640 1 Processor -- start 2024-05-12T22:52:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.059+0000 7f902cf15640 1 -- start start 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902cf15640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f902813f760 0x7f9028150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902cf15640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90280b6150 con 0x7f90280b5d70 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902cf15640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902806f620 con 0x7f9028149070 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902cf15640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f902806f990 con 0x7f902813f760 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90280b5d70 0x7f9028148960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33600/0 (socket says 172.21.15.40:33600) 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 -- 172.21.15.40:0/3281664919 learned_addr learned my addr 172.21.15.40:0/3281664919 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f9026d9d640 1 --2- 172.21.15.40:0/3281664919 >> v2:172.21.15.47:3300/0 conn(0x7f902813f760 0x7f9028150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017733449 0 0) 0x7f90280b6150 con 0x7f90280b5d70 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9014003530 con 0x7f90280b5d70 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1914415422 0 0) 0x7f9014003530 con 0x7f90280b5d70 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 >> v2:172.21.15.47:3300/0 conn(0x7f902813f760 msgr2=0x7f9028150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 --2- 172.21.15.40:0/3281664919 >> v2:172.21.15.47:3300/0 conn(0x7f902813f760 0x7f9028150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 >> v1:172.21.15.47:6789/0 conn(0x7f9028149070 legacy=0x7f902813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90280b4ea0 con 0x7f90280b5d70 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f9010001680 con 0x7f90280b5d70 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 >> v1:172.21.15.40:6789/0 conn(0x7f90280b5d70 legacy=0x7f9028148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 0x7f9014003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9014004810 0x7f9014004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90140051d0 0x7f901400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f901400c140 con 0x7f90140039c0 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f901400c2f0 con 0x7f9014004810 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f901400c4f0 con 0x7f90140051d0 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 0x7f9014003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f9025d9b640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9014004810 0x7f9014004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 -- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90140051d0 msgr2=0x7f901400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f90140051d0 0x7f901400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 -- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9014004810 msgr2=0x7f9014004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9014004810 0x7f9014004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f9026d9d640 1 -- 172.21.15.40:0/3281664919 reap_dead start 2024-05-12T22:52:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.063+0000 7f902659c640 1 -- 172.21.15.40:0/3281664919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9014003530 con 0x7f90140039c0 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902659c640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 0x7f9014003de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f901000c240 tx=0x7f901001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e660077c3b9a5c49 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010007d20 con 0x7f90140039c0 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90100a9070 con 0x7f90140039c0 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902559a640 1 -- 172.21.15.40:0/3281664919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90100a5e00 con 0x7f90140039c0 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 msgr2=0x7f9014003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 0x7f9014003de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f901000c240 tx=0x7f901001cc40 comp rx=0 tx=0).stop 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/3281664919 shutdown_connections 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 --2- 172.21.15.40:0/3281664919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90140039c0 0x7f9014003de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/3281664919 >> 172.21.15.40:0/3281664919 conn(0x7f902806b6c0 msgr2=0x7f902806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/3281664919 shutdown_connections 2024-05-12T22:52:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/3281664919 wait complete. 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 Processor -- start 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- start start 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90140039c0 0x7f90281d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9028148450 0x7f902813cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f902813f3e0 con 0x7f90281424b0 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f902813f260 con 0x7f90140039c0 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f902813f560 con 0x7f9028148450 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59380/0 (socket says 172.21.15.40:59380) 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 -- 172.21.15.40:0/264253857 learned_addr learned my addr 172.21.15.40:0/264253857 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902659c640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90140039c0 0x7f90281d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9026d9d640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9028148450 0x7f902813cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 -- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9028148450 msgr2=0x7f902813cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9028148450 0x7f902813cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 -- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90140039c0 msgr2=0x7f90281d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90140039c0 0x7f90281d3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 -- 172.21.15.40:0/264253857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028142cb0 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f9025d9b640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9018001ec0 tx=0x7f901800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018019070 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90180052e0 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90281429d0 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018003820 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.067+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9028142020 con 0x7f90281424b0 2024-05-12T22:52:39.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9028068330 con 0x7f90281424b0 2024-05-12T22:52:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f901801c070 con 0x7f90281424b0 2024-05-12T22:52:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f901effd640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 0x7f9008069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9018085210 con 0x7f90281424b0 2024-05-12T22:52:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f902659c640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 0x7f9008069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.071+0000 7f902659c640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 0x7f9008069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90100ab000 tx=0x7f90100b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.075+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9018055790 con 0x7f90281424b0 2024-05-12T22:52:39.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.235+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90280b6ab0 con 0x7f90080678c0 2024-05-12T22:52:39.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.247+0000 7f901effd640 1 -- 172.21.15.40:0/264253857 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244115 (secure 0 0 0) 0x7f90280b6ab0 con 0x7f90080678c0 2024-05-12T22:52:39.249 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 msgr2=0x7f9008069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 0x7f9008069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90100ab000 tx=0x7f90100b1040 comp rx=0 tx=0).stop 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 msgr2=0x7f90281e14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9018001ec0 tx=0x7f901800e8a0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 shutdown_connections 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9028148450 0x7f902813cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90281424b0 0x7f90281e14e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f90080678c0 0x7f9008069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 --2- 172.21.15.40:0/264253857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90140039c0 0x7f90281d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 >> 172.21.15.40:0/264253857 conn(0x7f902806b6c0 msgr2=0x7f90280b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 shutdown_connections 2024-05-12T22:52:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.251+0000 7f902cf15640 1 -- 172.21.15.40:0/264253857 wait complete. 2024-05-12T22:52:39.268 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-12T22:52:37.345976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234384,"kb_used_data":1528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740336,"statfs":{"total":773094113280,"available":772854104064,"internally_reserved":0,"allocated":1564672,"data_stored":1629699,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556482+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:35.556482+0000","last_peered":"2024-05-12T22:52:35.556482+0000","last_clean":"2024-05-12T22:52:35.556482+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:35.556482+0000","last_undegraded":"2024-05-12T22:52:35.556482+0000","last_fullsized":"2024-05-12T22:52:35.556482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549705+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:35.549705+0000","last_peered":"2024-05-12T22:52:35.549705+0000","last_clean":"2024-05-12T22:52:35.549705+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:35.549705+0000","last_undegraded":"2024-05-12T22:52:35.549705+0000","last_fullsized":"2024-05-12T22:52:35.549705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:12:14.221710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574134+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:35.574134+0000","last_peered":"2024-05-12T22:52:35.574134+0000","last_clean":"2024-05-12T22:52:35.574134+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:35.574134+0000","last_undegraded":"2024-05-12T22:52:35.574134+0000","last_fullsized":"2024-05-12T22:52:35.574134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:24:44.471953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553634+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:35.553634+0000","last_peered":"2024-05-12T22:52:35.553634+0000","last_clean":"2024-05-12T22:52:35.553634+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:35.553634+0000","last_undegraded":"2024-05-12T22:52:35.553634+0000","last_fullsized":"2024-05-12T22:52:35.553634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553951+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:35.553951+0000","last_peered":"2024-05-12T22:52:35.553951+0000","last_clean":"2024-05-12T22:52:35.553951+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:35.553951+0000","last_undegraded":"2024-05-12T22:52:35.553951+0000","last_fullsized":"2024-05-12T22:52:35.553951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:10.856297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586648+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:35.586648+0000","last_peered":"2024-05-12T22:52:35.586648+0000","last_clean":"2024-05-12T22:52:35.586648+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:35.586648+0000","last_undegraded":"2024-05-12T22:52:35.586648+0000","last_fullsized":"2024-05-12T22:52:35.586648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565676+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:35.565676+0000","last_peered":"2024-05-12T22:52:35.565676+0000","last_clean":"2024-05-12T22:52:35.565676+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:35.565676+0000","last_undegraded":"2024-05-12T22:52:35.565676+0000","last_fullsized":"2024-05-12T22:52:35.565676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.587083+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:35.587083+0000","last_peered":"2024-05-12T22:52:35.587083+0000","last_clean":"2024-05-12T22:52:35.587083+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:35.587083+0000","last_undegraded":"2024-05-12T22:52:35.587083+0000","last_fullsized":"2024-05-12T22:52:35.587083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586569+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:35.586569+0000","last_peered":"2024-05-12T22:52:35.586569+0000","last_clean":"2024-05-12T22:52:35.586569+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:35.586569+0000","last_undegraded":"2024-05-12T22:52:35.586569+0000","last_fullsized":"2024-05-12T22:52:35.586569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:21:45.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581842+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:35.581842+0000","last_peered":"2024-05-12T22:52:35.581842+0000","last_clean":"2024-05-12T22:52:35.581842+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:35.581842+0000","last_undegraded":"2024-05-12T22:52:35.581842+0000","last_fullsized":"2024-05-12T22:52:35.581842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:14.906365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553690+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:35.553690+0000","last_peered":"2024-05-12T22:52:35.553690+0000","last_clean":"2024-05-12T22:52:35.553690+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:35.553690+0000","last_undegraded":"2024-05-12T22:52:35.553690+0000","last_fullsized":"2024-05-12T22:52:35.553690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.592261+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:35.592261+0000","last_peered":"2024-05-12T22:52:35.592261+0000","last_clean":"2024-05-12T22:52:35.592261+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:35.592261+0000","last_undegraded":"2024-05-12T22:52:35.592261+0000","last_fullsized":"2024-05-12T22:52:35.592261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:30:18.683890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.552631+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:35.552631+0000","last_peered":"2024-05-12T22:52:35.552631+0000","last_clean":"2024-05-12T22:52:35.552631+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:35.552631+0000","last_undegraded":"2024-05-12T22:52:35.552631+0000","last_fullsized":"2024-05-12T22:52:35.552631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:16.324485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.568621+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:35.568621+0000","last_peered":"2024-05-12T22:52:35.568621+0000","last_clean":"2024-05-12T22:52:35.568621+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:35.568621+0000","last_undegraded":"2024-05-12T22:52:35.568621+0000","last_fullsized":"2024-05-12T22:52:35.568621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549952+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:35.549952+0000","last_peered":"2024-05-12T22:52:35.549952+0000","last_clean":"2024-05-12T22:52:35.549952+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:35.549952+0000","last_undegraded":"2024-05-12T22:52:35.549952+0000","last_fullsized":"2024-05-12T22:52:35.549952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:39.594007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.533656+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:35.533656+0000","last_peered":"2024-05-12T22:52:35.533656+0000","last_clean":"2024-05-12T22:52:35.533656+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:35.533656+0000","last_undegraded":"2024-05-12T22:52:35.533656+0000","last_fullsized":"2024-05-12T22:52:35.533656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553112+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:35.553112+0000","last_peered":"2024-05-12T22:52:35.553112+0000","last_clean":"2024-05-12T22:52:35.553112+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:35.553112+0000","last_undegraded":"2024-05-12T22:52:35.553112+0000","last_fullsized":"2024-05-12T22:52:35.553112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:40.158701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556318+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:35.556318+0000","last_peered":"2024-05-12T22:52:35.556318+0000","last_clean":"2024-05-12T22:52:35.556318+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:35.556318+0000","last_undegraded":"2024-05-12T22:52:35.556318+0000","last_fullsized":"2024-05-12T22:52:35.556318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561149+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:35.561149+0000","last_peered":"2024-05-12T22:52:35.561149+0000","last_clean":"2024-05-12T22:52:35.561149+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:35.561149+0000","last_undegraded":"2024-05-12T22:52:35.561149+0000","last_fullsized":"2024-05-12T22:52:35.561149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565291+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:35.565291+0000","last_peered":"2024-05-12T22:52:35.565291+0000","last_clean":"2024-05-12T22:52:35.565291+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:35.565291+0000","last_undegraded":"2024-05-12T22:52:35.565291+0000","last_fullsized":"2024-05-12T22:52:35.565291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.596836+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:35.596836+0000","last_peered":"2024-05-12T22:52:35.596836+0000","last_clean":"2024-05-12T22:52:35.596836+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:35.596836+0000","last_undegraded":"2024-05-12T22:52:35.596836+0000","last_fullsized":"2024-05-12T22:52:35.596836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.569090+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:35.569090+0000","last_peered":"2024-05-12T22:52:35.569090+0000","last_clean":"2024-05-12T22:52:35.569090+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:35.569090+0000","last_undegraded":"2024-05-12T22:52:35.569090+0000","last_fullsized":"2024-05-12T22:52:35.569090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.557202+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:35.557202+0000","last_peered":"2024-05-12T22:52:35.557202+0000","last_clean":"2024-05-12T22:52:35.557202+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:35.557202+0000","last_undegraded":"2024-05-12T22:52:35.557202+0000","last_fullsized":"2024-05-12T22:52:35.557202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.548001+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:35.548001+0000","last_peered":"2024-05-12T22:52:35.548001+0000","last_clean":"2024-05-12T22:52:35.548001+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:35.548001+0000","last_undegraded":"2024-05-12T22:52:35.548001+0000","last_fullsized":"2024-05-12T22:52:35.548001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.585239+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:35.585239+0000","last_peered":"2024-05-12T22:52:35.585239+0000","last_clean":"2024-05-12T22:52:35.585239+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:35.585239+0000","last_undegraded":"2024-05-12T22:52:35.585239+0000","last_fullsized":"2024-05-12T22:52:35.585239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538480+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:35.538480+0000","last_peered":"2024-05-12T22:52:35.538480+0000","last_clean":"2024-05-12T22:52:35.538480+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:35.538480+0000","last_undegraded":"2024-05-12T22:52:35.538480+0000","last_fullsized":"2024-05-12T22:52:35.538480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-12T22:52:24.501825+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:24.501825+0000","last_peered":"2024-05-12T22:52:24.501825+0000","last_clean":"2024-05-12T22:52:24.501825+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:24.501825+0000","last_undegraded":"2024-05-12T22:52:24.501825+0000","last_fullsized":"2024-05-12T22:52:24.501825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574083+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:35.574083+0000","last_peered":"2024-05-12T22:52:35.574083+0000","last_clean":"2024-05-12T22:52:35.574083+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:35.574083+0000","last_undegraded":"2024-05-12T22:52:35.574083+0000","last_fullsized":"2024-05-12T22:52:35.574083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:04.940250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538202+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:35.538202+0000","last_peered":"2024-05-12T22:52:35.538202+0000","last_clean":"2024-05-12T22:52:35.538202+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:35.538202+0000","last_undegraded":"2024-05-12T22:52:35.538202+0000","last_fullsized":"2024-05-12T22:52:35.538202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558867+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:35.558867+0000","last_peered":"2024-05-12T22:52:35.558867+0000","last_clean":"2024-05-12T22:52:35.558867+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:35.558867+0000","last_undegraded":"2024-05-12T22:52:35.558867+0000","last_fullsized":"2024-05-12T22:52:35.558867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537595+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:35.537595+0000","last_peered":"2024-05-12T22:52:35.537595+0000","last_clean":"2024-05-12T22:52:35.537595+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:35.537595+0000","last_undegraded":"2024-05-12T22:52:35.537595+0000","last_fullsized":"2024-05-12T22:52:35.537595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556448+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:35.556448+0000","last_peered":"2024-05-12T22:52:35.556448+0000","last_clean":"2024-05-12T22:52:35.556448+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:35.556448+0000","last_undegraded":"2024-05-12T22:52:35.556448+0000","last_fullsized":"2024-05-12T22:52:35.556448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537353+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:35.537353+0000","last_peered":"2024-05-12T22:52:35.537353+0000","last_clean":"2024-05-12T22:52:35.537353+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:35.537353+0000","last_undegraded":"2024-05-12T22:52:35.537353+0000","last_fullsized":"2024-05-12T22:52:35.537353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.576833+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:35.576833+0000","last_peered":"2024-05-12T22:52:35.576833+0000","last_clean":"2024-05-12T22:52:35.576833+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:35.576833+0000","last_undegraded":"2024-05-12T22:52:35.576833+0000","last_fullsized":"2024-05-12T22:52:35.576833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:04:00.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553977+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:35.553977+0000","last_peered":"2024-05-12T22:52:35.553977+0000","last_clean":"2024-05-12T22:52:35.553977+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:35.553977+0000","last_undegraded":"2024-05-12T22:52:35.553977+0000","last_fullsized":"2024-05-12T22:52:35.553977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:14.936593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537146+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:35.537146+0000","last_peered":"2024-05-12T22:52:35.537146+0000","last_clean":"2024-05-12T22:52:35.537146+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:35.537146+0000","last_undegraded":"2024-05-12T22:52:35.537146+0000","last_fullsized":"2024-05-12T22:52:35.537146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558133+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:35.558133+0000","last_peered":"2024-05-12T22:52:35.558133+0000","last_clean":"2024-05-12T22:52:35.558133+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:35.558133+0000","last_undegraded":"2024-05-12T22:52:35.558133+0000","last_fullsized":"2024-05-12T22:52:35.558133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537529+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:35.537529+0000","last_peered":"2024-05-12T22:52:35.537529+0000","last_clean":"2024-05-12T22:52:35.537529+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:35.537529+0000","last_undegraded":"2024-05-12T22:52:35.537529+0000","last_fullsized":"2024-05-12T22:52:35.537529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.555615+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:35.555615+0000","last_peered":"2024-05-12T22:52:35.555615+0000","last_clean":"2024-05-12T22:52:35.555615+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:35.555615+0000","last_undegraded":"2024-05-12T22:52:35.555615+0000","last_fullsized":"2024-05-12T22:52:35.555615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:34.510384+0000","last_change":"2024-05-12T22:52:34.510384+0000","last_active":"2024-05-12T22:52:34.510384+0000","last_peered":"2024-05-12T22:52:34.510384+0000","last_clean":"2024-05-12T22:52:34.510384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:34.510384+0000","last_undegraded":"2024-05-12T22:52:34.510384+0000","last_fullsized":"2024-05-12T22:52:34.510384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-12T22:52:33.501530+0000","last_change":"2024-05-12T22:52:33.501530+0000","last_active":"2024-05-12T22:52:33.501530+0000","last_peered":"2024-05-12T22:52:33.501530+0000","last_clean":"2024-05-12T22:52:33.501530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-12T22:52:33.501530+0000","last_undegraded":"2024-05-12T22:52:33.501530+0000","last_fullsized":"2024-05-12T22:52:33.501530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561135+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:35.561135+0000","last_peered":"2024-05-12T22:52:35.561135+0000","last_clean":"2024-05-12T22:52:35.561135+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:35.561135+0000","last_undegraded":"2024-05-12T22:52:35.561135+0000","last_fullsized":"2024-05-12T22:52:35.561135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:47.873600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.551566+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:35.551566+0000","last_peered":"2024-05-12T22:52:35.551566+0000","last_clean":"2024-05-12T22:52:35.551566+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:35.551566+0000","last_undegraded":"2024-05-12T22:52:35.551566+0000","last_fullsized":"2024-05-12T22:52:35.551566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.560815+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:35.560815+0000","last_peered":"2024-05-12T22:52:35.560815+0000","last_clean":"2024-05-12T22:52:35.560815+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:35.560815+0000","last_undegraded":"2024-05-12T22:52:35.560815+0000","last_fullsized":"2024-05-12T22:52:35.560815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.591745+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:35.591745+0000","last_peered":"2024-05-12T22:52:35.591745+0000","last_clean":"2024-05-12T22:52:35.591745+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:35.591745+0000","last_undegraded":"2024-05-12T22:52:35.591745+0000","last_fullsized":"2024-05-12T22:52:35.591745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":225280,"data_stored":637802,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":657307,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-05-12T22:52:39.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-05-12T22:52:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-05-12T22:52:39.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-05-12T22:52:39.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-05-12T22:52:39.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-05-12T22:52:39.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-05-12T22:52:39.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:34.510384+0000', 'last_change': '2024-05-12T22:52:34.510384+0000', 'last_active': '2024-05-12T22:52:34.510384+0000', 'last_peered': '2024-05-12T22:52:34.510384+0000', 'last_clean': '2024-05-12T22:52:34.510384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:34.510384+0000', 'last_undegraded': '2024-05-12T22:52:34.510384+0000', 'last_fullsized': '2024-05-12T22:52:34.510384+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:34.510384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-05-12T22:52:39.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-12T22:52:33.501530+0000', 'last_change': '2024-05-12T22:52:33.501530+0000', 'last_active': '2024-05-12T22:52:33.501530+0000', 'last_peered': '2024-05-12T22:52:33.501530+0000', 'last_clean': '2024-05-12T22:52:33.501530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-12T22:52:33.501530+0000', 'last_undegraded': '2024-05-12T22:52:33.501530+0000', 'last_fullsized': '2024-05-12T22:52:33.501530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'last_clean_scrub_stamp': '2024-05-12T22:52:33.501530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-12T22:52:39.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-12T22:52:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 Processor -- start 2024-05-12T22:52:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 -- start start 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f193c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193c0b21f0 con 0x7f193c0b6100 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193c06f9e0 con 0x7f193c0b5d20 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1944517640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f193c0729f0 con 0x7f193c1482b0 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1941ab2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f193c0b6100 0x7f193c147ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33612/0 (socket says 172.21.15.40:33612) 2024-05-12T22:52:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1941ab2640 1 -- 172.21.15.40:0/2086144452 learned_addr learned my addr 172.21.15.40:0/2086144452 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f1942ab4640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f193c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609646263 0 0) 0x7f193c0b21f0 con 0x7f193c0b6100 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1928003530 con 0x7f193c0b6100 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2678854156 0 0) 0x7f1928003530 con 0x7f193c0b6100 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 msgr2=0x7f193c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f193c0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 >> v1:172.21.15.47:6789/0 conn(0x7f193c0b5d20 legacy=0x7f193c0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c0b2490 con 0x7f193c0b6100 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.435+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f1938001680 con 0x7f193c0b6100 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 >> v1:172.21.15.40:6789/0 conn(0x7f193c0b6100 legacy=0x7f193c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19280039f0 0x7f1928003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1928004810 0x7f1928004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f1928005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f193c0729f0 con 0x7f19280039f0 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f192800bb60 con 0x7f1928004810 2024-05-12T22:52:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f192800bd30 con 0x7f193c1482b0 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19280039f0 0x7f1928003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1942ab4640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f1928005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1941ab2640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1928004810 0x7f1928004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 -- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 msgr2=0x7f1928005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f193c1482b0 0x7f1928005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 -- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1928004810 msgr2=0x7f1928004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1928004810 0x7f1928004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 -- 172.21.15.40:0/2086144452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1928003530 con 0x7f19280039f0 2024-05-12T22:52:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1941ab2640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1928004810 0x7f1928004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:39.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19422b3640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19280039f0 0x7f1928003df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1930001890 tx=0x7f193001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b87a95441001c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300b1070 con 0x7f19280039f0 2024-05-12T22:52:39.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300ac620 con 0x7f19280039f0 2024-05-12T22:52:39.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f19412b1640 1 -- 172.21.15.40:0/2086144452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930001460 con 0x7f19280039f0 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 -- 172.21.15.40:0/2086144452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19280039f0 msgr2=0x7f1928003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 --2- 172.21.15.40:0/2086144452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19280039f0 0x7f1928003df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1930001890 tx=0x7f193001c500 comp rx=0 tx=0).stop 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1942ab4640 1 -- 172.21.15.40:0/2086144452 reap_dead start 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 -- 172.21.15.40:0/2086144452 shutdown_connections 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 -- 172.21.15.40:0/2086144452 >> 172.21.15.40:0/2086144452 conn(0x7f193c0b9300 msgr2=0x7f193c0b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 -- 172.21.15.40:0/2086144452 shutdown_connections 2024-05-12T22:52:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.439+0000 7f1944517640 1 -- 172.21.15.40:0/2086144452 wait complete. 2024-05-12T22:52:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 Processor -- start 2024-05-12T22:52:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- start start 2024-05-12T22:52:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f19280039f0 0x7f193c1dc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f193c1470b0 0x7f193c136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1503c0 con 0x7f193c139f40 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f193c073070 con 0x7f193c1470b0 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f193c150540 con 0x7f19280039f0 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59404/0 (socket says 172.21.15.40:59404) 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 -- 172.21.15.40:0/444725153 learned_addr learned my addr 172.21.15.40:0/444725153 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f19422b3640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f19280039f0 0x7f193c1dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1941ab2640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f193c1470b0 0x7f193c136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 -- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f19280039f0 msgr2=0x7f193c1dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f19280039f0 0x7f193c1dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 -- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f193c1470b0 msgr2=0x7f193c136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f193c1470b0 0x7f193c136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 -- 172.21.15.40:0/444725153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c147660 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1942ab4640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b8ac0 tx=0x7f193400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193401c070 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1934017400 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c139740 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19340177f0 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c139280 con 0x7f193c139f40 2024-05-12T22:52:39.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193c068330 con 0x7f193c139f40 2024-05-12T22:52:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f193401f070 con 0x7f193c139f40 2024-05-12T22:52:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 0x7f1920069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1934085b20 con 0x7f193c139f40 2024-05-12T22:52:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.443+0000 7f19422b3640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 0x7f1920069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.447+0000 7f19422b3640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 0x7f1920069db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19300ae000 tx=0x7f1930005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.451+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1934012070 con 0x7f193c139f40 2024-05-12T22:52:39.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f193c06f700 con 0x7f193c139f40 2024-05-12T22:52:39.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f192effd640 1 -- 172.21.15.40:0/444725153 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1012 (secure 0 0 0) 0x7f19340560a0 con 0x7f193c139f40 2024-05-12T22:52:39.675 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:39.675 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1715554341,"num_in_osds":8,"osd_in_since":1715554332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":240173056,"bytes_avail":772853940224,"bytes_total":773094113280,"write_bytes_sec":2456,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4272}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-12T22:52:10.655595+0000","services":{}},"progress_events":{}} 2024-05-12T22:52:39.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 msgr2=0x7f1920069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 0x7f1920069db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19300ae000 tx=0x7f1930005040 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 msgr2=0x7f193c144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b8ac0 tx=0x7f193400f4a0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 shutdown_connections 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c139f40 0x7f193c144150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19200678f0 0x7f1920069db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f193c1470b0 0x7f193c136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 --2- 172.21.15.40:0/444725153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f19280039f0 0x7f193c1dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.675+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 >> 172.21.15.40:0/444725153 conn(0x7f193c0b9300 msgr2=0x7f193c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.679+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 shutdown_connections 2024-05-12T22:52:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.679+0000 7f1944517640 1 -- 172.21.15.40:0/444725153 wait complete. 2024-05-12T22:52:39.695 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-12T22:52:39.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:39.744 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-05-12T22:52:39.743+0000 7f80ccf90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-12T22:52:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.819+0000 7fe35d316640 1 Processor -- start 2024-05-12T22:52:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.819+0000 7fe35d316640 1 -- start start 2024-05-12T22:52:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe35d316640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 0x7fe3581410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe35d316640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3580b5d90 con 0x7fe358141630 2024-05-12T22:52:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe35d316640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3580b6fe0 con 0x7fe3580b59b0 2024-05-12T22:52:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe35d316640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe358148540 con 0x7fe3580b4ac0 2024-05-12T22:52:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe358141630 0x7fe358151ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51576/0 (socket says 172.21.15.40:51576) 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 -- 172.21.15.40:0/654108291 learned_addr learned my addr 172.21.15.40:0/654108291 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3567fc640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 0x7fe3581410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086238957 0 0) 0x7fe3580b5d90 con 0x7fe358141630 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe340003530 con 0x7fe358141630 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1311549242 0 0) 0x7fe340003530 con 0x7fe358141630 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 msgr2=0x7fe3581410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 0x7fe3581410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 >> v1:172.21.15.47:6789/0 conn(0x7fe3580b59b0 legacy=0x7fe358147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580b5110 con 0x7fe358141630 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fe350001a00 con 0x7fe358141630 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 >> v1:172.21.15.40:6789/0 conn(0x7fe358141630 legacy=0x7fe358151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3400039f0 0x7fe340003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 0x7fe340004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe340004d50 0x7fe3400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe358148540 con 0x7fe340004d50 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000bb30 con 0x7fe3400039f0 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe34000bd30 con 0x7fe3580b4ac0 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe340004d50 0x7fe3400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe356ffd640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3400039f0 0x7fe340003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 -- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 msgr2=0x7fe340004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3580b4ac0 0x7fe340004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 -- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3400039f0 msgr2=0x7fe340003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3400039f0 0x7fe340003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe3577fe640 1 -- 172.21.15.40:0/654108291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe340003530 con 0x7fe340004d50 2024-05-12T22:52:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.823+0000 7fe356ffd640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3400039f0 0x7fe340003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3577fe640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe340004d50 0x7fe3400051d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe35000a840 tx=0x7fe35001fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78647ac3b7df8c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35000a460 con 0x7fe340004d50 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3500aa710 con 0x7fe340004d50 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe355ffb640 1 -- 172.21.15.40:0/654108291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3500aab00 con 0x7fe340004d50 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/654108291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe340004d50 msgr2=0x7fe3400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 --2- 172.21.15.40:0/654108291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe340004d50 0x7fe3400051d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe35000a840 tx=0x7fe35001fac0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3577fe640 1 -- 172.21.15.40:0/654108291 reap_dead start 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/654108291 shutdown_connections 2024-05-12T22:52:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/654108291 >> 172.21.15.40:0/654108291 conn(0x7fe3580bce30 msgr2=0x7fe3580bd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/654108291 shutdown_connections 2024-05-12T22:52:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/654108291 wait complete. 2024-05-12T22:52:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 Processor -- start 2024-05-12T22:52:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- start start 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 0x7fe358141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3581e0260 0x7fe3581e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580b77b0 con 0x7fe3581ceea0 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe358147910 con 0x7fe3581cdcc0 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe358144820 con 0x7fe3581e0260 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59876/0 (socket says 172.21.15.40:59876) 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 -- 172.21.15.40:0/844010570 learned_addr learned my addr 172.21.15.40:0/844010570 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe356ffd640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 0x7fe358141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3577fe640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3581e0260 0x7fe3581e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 -- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3581e0260 msgr2=0x7fe3581e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3581e0260 0x7fe3581e06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 -- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 msgr2=0x7fe358141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 0x7fe358141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 -- 172.21.15.40:0/844010570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3581cd600 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe356ffd640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 0x7fe358141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe3567fc640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00e7f0 tx=0x7fe34c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c017070 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c00c860 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3581cf3b0 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00cc30 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.827+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3580b3780 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe358068330 con 0x7fe3581ceea0 2024-05-12T22:52:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe34c01a070 con 0x7fe3581ceea0 2024-05-12T22:52:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe33f7fe640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 0x7fe344069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe34c085ac0 con 0x7fe3581ceea0 2024-05-12T22:52:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe356ffd640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 0x7fe344069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.831+0000 7fe356ffd640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 0x7fe344069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe348001720 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.835+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe34c056600 con 0x7fe3581ceea0 2024-05-12T22:52:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:39.995+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3580678d0 con 0x7fe3440678c0 2024-05-12T22:52:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.011+0000 7fe33f7fe640 1 -- 172.21.15.40:0/844010570 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251994 (secure 0 0 0) 0x7fe3580678d0 con 0x7fe3440678c0 2024-05-12T22:52:40.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 msgr2=0x7fe344069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 0x7fe344069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe348001720 tx=0x7fe348009040 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 msgr2=0x7fe3581dfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00e7f0 tx=0x7fe34c00ecb0 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 shutdown_connections 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3581e0260 0x7fe3581e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3581ceea0 0x7fe3581dfd20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe3440678c0 0x7fe344069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 --2- 172.21.15.40:0/844010570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581cdcc0 0x7fe358141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 >> 172.21.15.40:0/844010570 conn(0x7fe3580bce30 msgr2=0x7fe358074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 shutdown_connections 2024-05-12T22:52:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:40.015+0000 7fe35d316640 1 -- 172.21.15.40:0/844010570 wait complete. 2024-05-12T22:52:40.034 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-12T22:52:39.346564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234544,"kb_used_data":1716,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740176,"statfs":{"total":773094113280,"available":772853940224,"internally_reserved":0,"allocated":1757184,"data_stored":1713877,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286162+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:52:37.286162+0000","last_peered":"2024-05-12T22:52:37.286162+0000","last_clean":"2024-05-12T22:52:37.286162+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:52:37.286162+0000","last_undegraded":"2024-05-12T22:52:37.286162+0000","last_fullsized":"2024-05-12T22:52:37.286162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556482+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:35.556482+0000","last_peered":"2024-05-12T22:52:35.556482+0000","last_clean":"2024-05-12T22:52:35.556482+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:35.556482+0000","last_undegraded":"2024-05-12T22:52:35.556482+0000","last_fullsized":"2024-05-12T22:52:35.556482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549705+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:35.549705+0000","last_peered":"2024-05-12T22:52:35.549705+0000","last_clean":"2024-05-12T22:52:35.549705+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:35.549705+0000","last_undegraded":"2024-05-12T22:52:35.549705+0000","last_fullsized":"2024-05-12T22:52:35.549705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:12:14.221710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555056+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:52:36.555056+0000","last_peered":"2024-05-12T22:52:36.555056+0000","last_clean":"2024-05-12T22:52:36.555056+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:52:36.555056+0000","last_undegraded":"2024-05-12T22:52:36.555056+0000","last_fullsized":"2024-05-12T22:52:36.555056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285942+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:52:37.285942+0000","last_peered":"2024-05-12T22:52:37.285942+0000","last_clean":"2024-05-12T22:52:37.285942+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:52:37.285942+0000","last_undegraded":"2024-05-12T22:52:37.285942+0000","last_fullsized":"2024-05-12T22:52:37.285942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553561+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:52:36.553561+0000","last_peered":"2024-05-12T22:52:36.553561+0000","last_clean":"2024-05-12T22:52:36.553561+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:52:36.553561+0000","last_undegraded":"2024-05-12T22:52:36.553561+0000","last_fullsized":"2024-05-12T22:52:36.553561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285020+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:52:37.285020+0000","last_peered":"2024-05-12T22:52:37.285020+0000","last_clean":"2024-05-12T22:52:37.285020+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:52:37.285020+0000","last_undegraded":"2024-05-12T22:52:37.285020+0000","last_fullsized":"2024-05-12T22:52:37.285020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574134+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:35.574134+0000","last_peered":"2024-05-12T22:52:35.574134+0000","last_clean":"2024-05-12T22:52:35.574134+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:35.574134+0000","last_undegraded":"2024-05-12T22:52:35.574134+0000","last_fullsized":"2024-05-12T22:52:35.574134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:24:44.471953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286375+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:52:37.286375+0000","last_peered":"2024-05-12T22:52:37.286375+0000","last_clean":"2024-05-12T22:52:37.286375+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:52:37.286375+0000","last_undegraded":"2024-05-12T22:52:37.286375+0000","last_fullsized":"2024-05-12T22:52:37.286375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806705+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:52:36.806705+0000","last_peered":"2024-05-12T22:52:36.806705+0000","last_clean":"2024-05-12T22:52:36.806705+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:52:36.806705+0000","last_undegraded":"2024-05-12T22:52:36.806705+0000","last_fullsized":"2024-05-12T22:52:36.806705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806145+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:52:36.806145+0000","last_peered":"2024-05-12T22:52:36.806145+0000","last_clean":"2024-05-12T22:52:36.806145+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:52:36.806145+0000","last_undegraded":"2024-05-12T22:52:36.806145+0000","last_fullsized":"2024-05-12T22:52:36.806145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554295+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:52:36.554295+0000","last_peered":"2024-05-12T22:52:36.554295+0000","last_clean":"2024-05-12T22:52:36.554295+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:52:36.554295+0000","last_undegraded":"2024-05-12T22:52:36.554295+0000","last_fullsized":"2024-05-12T22:52:36.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553634+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:35.553634+0000","last_peered":"2024-05-12T22:52:35.553634+0000","last_clean":"2024-05-12T22:52:35.553634+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:35.553634+0000","last_undegraded":"2024-05-12T22:52:35.553634+0000","last_fullsized":"2024-05-12T22:52:35.553634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553951+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:35.553951+0000","last_peered":"2024-05-12T22:52:35.553951+0000","last_clean":"2024-05-12T22:52:35.553951+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:35.553951+0000","last_undegraded":"2024-05-12T22:52:35.553951+0000","last_fullsized":"2024-05-12T22:52:35.553951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:10.856297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586648+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:35.586648+0000","last_peered":"2024-05-12T22:52:35.586648+0000","last_clean":"2024-05-12T22:52:35.586648+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:35.586648+0000","last_undegraded":"2024-05-12T22:52:35.586648+0000","last_fullsized":"2024-05-12T22:52:35.586648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552642+0000","last_change":"2024-05-12T22:52:35.564819+0000","last_active":"2024-05-12T22:52:36.552642+0000","last_peered":"2024-05-12T22:52:36.552642+0000","last_clean":"2024-05-12T22:52:36.552642+0000","last_became_active":"2024-05-12T22:52:35.564023+0000","last_became_peered":"2024-05-12T22:52:35.564023+0000","last_unstale":"2024-05-12T22:52:36.552642+0000","last_undegraded":"2024-05-12T22:52:36.552642+0000","last_fullsized":"2024-05-12T22:52:36.552642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556489+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:52:36.556489+0000","last_peered":"2024-05-12T22:52:36.556489+0000","last_clean":"2024-05-12T22:52:36.556489+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:52:36.556489+0000","last_undegraded":"2024-05-12T22:52:36.556489+0000","last_fullsized":"2024-05-12T22:52:36.556489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565676+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:35.565676+0000","last_peered":"2024-05-12T22:52:35.565676+0000","last_clean":"2024-05-12T22:52:35.565676+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:35.565676+0000","last_undegraded":"2024-05-12T22:52:35.565676+0000","last_fullsized":"2024-05-12T22:52:35.565676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286105+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:52:37.286105+0000","last_peered":"2024-05-12T22:52:37.286105+0000","last_clean":"2024-05-12T22:52:37.286105+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:52:37.286105+0000","last_undegraded":"2024-05-12T22:52:37.286105+0000","last_fullsized":"2024-05-12T22:52:37.286105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806066+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:52:36.806066+0000","last_peered":"2024-05-12T22:52:36.806066+0000","last_clean":"2024-05-12T22:52:36.806066+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:52:36.806066+0000","last_undegraded":"2024-05-12T22:52:36.806066+0000","last_fullsized":"2024-05-12T22:52:36.806066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.587083+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:35.587083+0000","last_peered":"2024-05-12T22:52:35.587083+0000","last_clean":"2024-05-12T22:52:35.587083+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:35.587083+0000","last_undegraded":"2024-05-12T22:52:35.587083+0000","last_fullsized":"2024-05-12T22:52:35.587083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555032+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:52:36.555032+0000","last_peered":"2024-05-12T22:52:36.555032+0000","last_clean":"2024-05-12T22:52:36.555032+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:52:36.555032+0000","last_undegraded":"2024-05-12T22:52:36.555032+0000","last_fullsized":"2024-05-12T22:52:36.555032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.586569+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:35.586569+0000","last_peered":"2024-05-12T22:52:35.586569+0000","last_clean":"2024-05-12T22:52:35.586569+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:35.586569+0000","last_undegraded":"2024-05-12T22:52:35.586569+0000","last_fullsized":"2024-05-12T22:52:35.586569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:21:45.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552901+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:52:36.552901+0000","last_peered":"2024-05-12T22:52:36.552901+0000","last_clean":"2024-05-12T22:52:36.552901+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:52:36.552901+0000","last_undegraded":"2024-05-12T22:52:36.552901+0000","last_fullsized":"2024-05-12T22:52:36.552901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581842+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:35.581842+0000","last_peered":"2024-05-12T22:52:35.581842+0000","last_clean":"2024-05-12T22:52:35.581842+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:35.581842+0000","last_undegraded":"2024-05-12T22:52:35.581842+0000","last_fullsized":"2024-05-12T22:52:35.581842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T22:58:14.906365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806703+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:52:36.806703+0000","last_peered":"2024-05-12T22:52:36.806703+0000","last_clean":"2024-05-12T22:52:36.806703+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:52:36.806703+0000","last_undegraded":"2024-05-12T22:52:36.806703+0000","last_fullsized":"2024-05-12T22:52:36.806703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553690+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:35.553690+0000","last_peered":"2024-05-12T22:52:35.553690+0000","last_clean":"2024-05-12T22:52:35.553690+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:35.553690+0000","last_undegraded":"2024-05-12T22:52:35.553690+0000","last_fullsized":"2024-05-12T22:52:35.553690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.592261+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:35.592261+0000","last_peered":"2024-05-12T22:52:35.592261+0000","last_clean":"2024-05-12T22:52:35.592261+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:35.592261+0000","last_undegraded":"2024-05-12T22:52:35.592261+0000","last_fullsized":"2024-05-12T22:52:35.592261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:30:18.683890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.552631+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:35.552631+0000","last_peered":"2024-05-12T22:52:35.552631+0000","last_clean":"2024-05-12T22:52:35.552631+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:35.552631+0000","last_undegraded":"2024-05-12T22:52:35.552631+0000","last_fullsized":"2024-05-12T22:52:35.552631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:16.324485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555256+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:52:36.555256+0000","last_peered":"2024-05-12T22:52:36.555256+0000","last_clean":"2024-05-12T22:52:36.555256+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:52:36.555256+0000","last_undegraded":"2024-05-12T22:52:36.555256+0000","last_fullsized":"2024-05-12T22:52:36.555256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.568621+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:35.568621+0000","last_peered":"2024-05-12T22:52:35.568621+0000","last_clean":"2024-05-12T22:52:35.568621+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:35.568621+0000","last_undegraded":"2024-05-12T22:52:35.568621+0000","last_fullsized":"2024-05-12T22:52:35.568621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805653+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:52:36.805653+0000","last_peered":"2024-05-12T22:52:36.805653+0000","last_clean":"2024-05-12T22:52:36.805653+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:52:36.805653+0000","last_undegraded":"2024-05-12T22:52:36.805653+0000","last_fullsized":"2024-05-12T22:52:36.805653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553533+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:52:36.553533+0000","last_peered":"2024-05-12T22:52:36.553533+0000","last_clean":"2024-05-12T22:52:36.553533+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:52:36.553533+0000","last_undegraded":"2024-05-12T22:52:36.553533+0000","last_fullsized":"2024-05-12T22:52:36.553533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.549952+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:35.549952+0000","last_peered":"2024-05-12T22:52:35.549952+0000","last_clean":"2024-05-12T22:52:35.549952+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:35.549952+0000","last_undegraded":"2024-05-12T22:52:35.549952+0000","last_fullsized":"2024-05-12T22:52:35.549952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:39.594007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805673+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:52:36.805673+0000","last_peered":"2024-05-12T22:52:36.805673+0000","last_clean":"2024-05-12T22:52:36.805673+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:52:36.805673+0000","last_undegraded":"2024-05-12T22:52:36.805673+0000","last_fullsized":"2024-05-12T22:52:36.805673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.533656+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:35.533656+0000","last_peered":"2024-05-12T22:52:35.533656+0000","last_clean":"2024-05-12T22:52:35.533656+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:35.533656+0000","last_undegraded":"2024-05-12T22:52:35.533656+0000","last_fullsized":"2024-05-12T22:52:35.533656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553112+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:35.553112+0000","last_peered":"2024-05-12T22:52:35.553112+0000","last_clean":"2024-05-12T22:52:35.553112+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:35.553112+0000","last_undegraded":"2024-05-12T22:52:35.553112+0000","last_fullsized":"2024-05-12T22:52:35.553112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:40.158701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553079+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:52:36.553079+0000","last_peered":"2024-05-12T22:52:36.553079+0000","last_clean":"2024-05-12T22:52:36.553079+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:52:36.553079+0000","last_undegraded":"2024-05-12T22:52:36.553079+0000","last_fullsized":"2024-05-12T22:52:36.553079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556318+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:35.556318+0000","last_peered":"2024-05-12T22:52:35.556318+0000","last_clean":"2024-05-12T22:52:35.556318+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:35.556318+0000","last_undegraded":"2024-05-12T22:52:35.556318+0000","last_fullsized":"2024-05-12T22:52:35.556318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806416+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:52:36.806416+0000","last_peered":"2024-05-12T22:52:36.806416+0000","last_clean":"2024-05-12T22:52:36.806416+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:52:36.806416+0000","last_undegraded":"2024-05-12T22:52:36.806416+0000","last_fullsized":"2024-05-12T22:52:36.806416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556220+0000","last_change":"2024-05-12T22:52:35.573997+0000","last_active":"2024-05-12T22:52:36.556220+0000","last_peered":"2024-05-12T22:52:36.556220+0000","last_clean":"2024-05-12T22:52:36.556220+0000","last_became_active":"2024-05-12T22:52:35.573264+0000","last_became_peered":"2024-05-12T22:52:35.573264+0000","last_unstale":"2024-05-12T22:52:36.556220+0000","last_undegraded":"2024-05-12T22:52:36.556220+0000","last_fullsized":"2024-05-12T22:52:36.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556467+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:52:36.556467+0000","last_peered":"2024-05-12T22:52:36.556467+0000","last_clean":"2024-05-12T22:52:36.556467+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:52:36.556467+0000","last_undegraded":"2024-05-12T22:52:36.556467+0000","last_fullsized":"2024-05-12T22:52:36.556467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561149+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:35.561149+0000","last_peered":"2024-05-12T22:52:35.561149+0000","last_clean":"2024-05-12T22:52:35.561149+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:35.561149+0000","last_undegraded":"2024-05-12T22:52:35.561149+0000","last_fullsized":"2024-05-12T22:52:35.561149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:15.567604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.565291+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:35.565291+0000","last_peered":"2024-05-12T22:52:35.565291+0000","last_clean":"2024-05-12T22:52:35.565291+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:35.565291+0000","last_undegraded":"2024-05-12T22:52:35.565291+0000","last_fullsized":"2024-05-12T22:52:35.565291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554358+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:52:36.554358+0000","last_peered":"2024-05-12T22:52:36.554358+0000","last_clean":"2024-05-12T22:52:36.554358+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:52:36.554358+0000","last_undegraded":"2024-05-12T22:52:36.554358+0000","last_fullsized":"2024-05-12T22:52:36.554358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805922+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:52:36.805922+0000","last_peered":"2024-05-12T22:52:36.805922+0000","last_clean":"2024-05-12T22:52:36.805922+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:52:36.805922+0000","last_undegraded":"2024-05-12T22:52:36.805922+0000","last_fullsized":"2024-05-12T22:52:36.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285389+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:52:37.285389+0000","last_peered":"2024-05-12T22:52:37.285389+0000","last_clean":"2024-05-12T22:52:37.285389+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:52:37.285389+0000","last_undegraded":"2024-05-12T22:52:37.285389+0000","last_fullsized":"2024-05-12T22:52:37.285389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.596836+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:35.596836+0000","last_peered":"2024-05-12T22:52:35.596836+0000","last_clean":"2024-05-12T22:52:35.596836+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:35.596836+0000","last_undegraded":"2024-05-12T22:52:35.596836+0000","last_fullsized":"2024-05-12T22:52:35.596836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.569090+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:35.569090+0000","last_peered":"2024-05-12T22:52:35.569090+0000","last_clean":"2024-05-12T22:52:35.569090+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:35.569090+0000","last_undegraded":"2024-05-12T22:52:35.569090+0000","last_fullsized":"2024-05-12T22:52:35.569090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:13.612120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555310+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:52:36.555310+0000","last_peered":"2024-05-12T22:52:36.555310+0000","last_clean":"2024-05-12T22:52:36.555310+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:52:36.555310+0000","last_undegraded":"2024-05-12T22:52:36.555310+0000","last_fullsized":"2024-05-12T22:52:36.555310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285573+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:52:37.285573+0000","last_peered":"2024-05-12T22:52:37.285573+0000","last_clean":"2024-05-12T22:52:37.285573+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:52:37.285573+0000","last_undegraded":"2024-05-12T22:52:37.285573+0000","last_fullsized":"2024-05-12T22:52:37.285573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805974+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:52:36.805974+0000","last_peered":"2024-05-12T22:52:36.805974+0000","last_clean":"2024-05-12T22:52:36.805974+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:52:36.805974+0000","last_undegraded":"2024-05-12T22:52:36.805974+0000","last_fullsized":"2024-05-12T22:52:36.805974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805837+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:52:36.805837+0000","last_peered":"2024-05-12T22:52:36.805837+0000","last_clean":"2024-05-12T22:52:36.805837+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:52:36.805837+0000","last_undegraded":"2024-05-12T22:52:36.805837+0000","last_fullsized":"2024-05-12T22:52:36.805837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.557202+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:35.557202+0000","last_peered":"2024-05-12T22:52:35.557202+0000","last_clean":"2024-05-12T22:52:35.557202+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:35.557202+0000","last_undegraded":"2024-05-12T22:52:35.557202+0000","last_fullsized":"2024-05-12T22:52:35.557202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285096+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:52:37.285096+0000","last_peered":"2024-05-12T22:52:37.285096+0000","last_clean":"2024-05-12T22:52:37.285096+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:52:37.285096+0000","last_undegraded":"2024-05-12T22:52:37.285096+0000","last_fullsized":"2024-05-12T22:52:37.285096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554755+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:52:36.554755+0000","last_peered":"2024-05-12T22:52:36.554755+0000","last_clean":"2024-05-12T22:52:36.554755+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:52:36.554755+0000","last_undegraded":"2024-05-12T22:52:36.554755+0000","last_fullsized":"2024-05-12T22:52:36.554755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285734+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:52:37.285734+0000","last_peered":"2024-05-12T22:52:37.285734+0000","last_clean":"2024-05-12T22:52:37.285734+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:52:37.285734+0000","last_undegraded":"2024-05-12T22:52:37.285734+0000","last_fullsized":"2024-05-12T22:52:37.285734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.548001+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:35.548001+0000","last_peered":"2024-05-12T22:52:35.548001+0000","last_clean":"2024-05-12T22:52:35.548001+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:35.548001+0000","last_undegraded":"2024-05-12T22:52:35.548001+0000","last_fullsized":"2024-05-12T22:52:35.548001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286529+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:52:37.286529+0000","last_peered":"2024-05-12T22:52:37.286529+0000","last_clean":"2024-05-12T22:52:37.286529+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:52:37.286529+0000","last_undegraded":"2024-05-12T22:52:37.286529+0000","last_fullsized":"2024-05-12T22:52:37.286529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.585239+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:35.585239+0000","last_peered":"2024-05-12T22:52:35.585239+0000","last_clean":"2024-05-12T22:52:35.585239+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:35.585239+0000","last_undegraded":"2024-05-12T22:52:35.585239+0000","last_fullsized":"2024-05-12T22:52:35.585239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555376+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:52:36.555376+0000","last_peered":"2024-05-12T22:52:36.555376+0000","last_clean":"2024-05-12T22:52:36.555376+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:52:36.555376+0000","last_undegraded":"2024-05-12T22:52:36.555376+0000","last_fullsized":"2024-05-12T22:52:36.555376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538480+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:35.538480+0000","last_peered":"2024-05-12T22:52:35.538480+0000","last_clean":"2024-05-12T22:52:35.538480+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:35.538480+0000","last_undegraded":"2024-05-12T22:52:35.538480+0000","last_fullsized":"2024-05-12T22:52:35.538480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285638+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:52:37.285638+0000","last_peered":"2024-05-12T22:52:37.285638+0000","last_clean":"2024-05-12T22:52:37.285638+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:52:37.285638+0000","last_undegraded":"2024-05-12T22:52:37.285638+0000","last_fullsized":"2024-05-12T22:52:37.285638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284734+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:37.284734+0000","last_peered":"2024-05-12T22:52:37.284734+0000","last_clean":"2024-05-12T22:52:37.284734+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:37.284734+0000","last_undegraded":"2024-05-12T22:52:37.284734+0000","last_fullsized":"2024-05-12T22:52:37.284734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554095+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:52:36.554095+0000","last_peered":"2024-05-12T22:52:36.554095+0000","last_clean":"2024-05-12T22:52:36.554095+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:52:36.554095+0000","last_undegraded":"2024-05-12T22:52:36.554095+0000","last_fullsized":"2024-05-12T22:52:36.554095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.574083+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:35.574083+0000","last_peered":"2024-05-12T22:52:35.574083+0000","last_clean":"2024-05-12T22:52:35.574083+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:35.574083+0000","last_undegraded":"2024-05-12T22:52:35.574083+0000","last_fullsized":"2024-05-12T22:52:35.574083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284582+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:52:37.284582+0000","last_peered":"2024-05-12T22:52:37.284582+0000","last_clean":"2024-05-12T22:52:37.284582+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:52:37.284582+0000","last_undegraded":"2024-05-12T22:52:37.284582+0000","last_fullsized":"2024-05-12T22:52:37.284582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.581825+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:35.581825+0000","last_peered":"2024-05-12T22:52:35.581825+0000","last_clean":"2024-05-12T22:52:35.581825+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:35.581825+0000","last_undegraded":"2024-05-12T22:52:35.581825+0000","last_fullsized":"2024-05-12T22:52:35.581825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:04.940250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.538202+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:35.538202+0000","last_peered":"2024-05-12T22:52:35.538202+0000","last_clean":"2024-05-12T22:52:35.538202+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:35.538202+0000","last_undegraded":"2024-05-12T22:52:35.538202+0000","last_fullsized":"2024-05-12T22:52:35.538202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558867+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:35.558867+0000","last_peered":"2024-05-12T22:52:35.558867+0000","last_clean":"2024-05-12T22:52:35.558867+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:35.558867+0000","last_undegraded":"2024-05-12T22:52:35.558867+0000","last_fullsized":"2024-05-12T22:52:35.558867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555532+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:52:36.555532+0000","last_peered":"2024-05-12T22:52:36.555532+0000","last_clean":"2024-05-12T22:52:36.555532+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:52:36.555532+0000","last_undegraded":"2024-05-12T22:52:36.555532+0000","last_fullsized":"2024-05-12T22:52:36.555532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553978+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:52:36.553978+0000","last_peered":"2024-05-12T22:52:36.553978+0000","last_clean":"2024-05-12T22:52:36.553978+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:52:36.553978+0000","last_undegraded":"2024-05-12T22:52:36.553978+0000","last_fullsized":"2024-05-12T22:52:36.553978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537595+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:35.537595+0000","last_peered":"2024-05-12T22:52:35.537595+0000","last_clean":"2024-05-12T22:52:35.537595+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:35.537595+0000","last_undegraded":"2024-05-12T22:52:35.537595+0000","last_fullsized":"2024-05-12T22:52:35.537595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556158+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:52:36.556158+0000","last_peered":"2024-05-12T22:52:36.556158+0000","last_clean":"2024-05-12T22:52:36.556158+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:52:36.556158+0000","last_undegraded":"2024-05-12T22:52:36.556158+0000","last_fullsized":"2024-05-12T22:52:36.556158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285916+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:52:37.285916+0000","last_peered":"2024-05-12T22:52:37.285916+0000","last_clean":"2024-05-12T22:52:37.285916+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:52:37.285916+0000","last_undegraded":"2024-05-12T22:52:37.285916+0000","last_fullsized":"2024-05-12T22:52:37.285916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.556448+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:35.556448+0000","last_peered":"2024-05-12T22:52:35.556448+0000","last_clean":"2024-05-12T22:52:35.556448+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:35.556448+0000","last_undegraded":"2024-05-12T22:52:35.556448+0000","last_fullsized":"2024-05-12T22:52:35.556448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537353+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:35.537353+0000","last_peered":"2024-05-12T22:52:35.537353+0000","last_clean":"2024-05-12T22:52:35.537353+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:35.537353+0000","last_undegraded":"2024-05-12T22:52:35.537353+0000","last_fullsized":"2024-05-12T22:52:35.537353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.576833+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:35.576833+0000","last_peered":"2024-05-12T22:52:35.576833+0000","last_clean":"2024-05-12T22:52:35.576833+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:35.576833+0000","last_undegraded":"2024-05-12T22:52:35.576833+0000","last_fullsized":"2024-05-12T22:52:35.576833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:04:00.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806544+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:52:36.806544+0000","last_peered":"2024-05-12T22:52:36.806544+0000","last_clean":"2024-05-12T22:52:36.806544+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:52:36.806544+0000","last_undegraded":"2024-05-12T22:52:36.806544+0000","last_fullsized":"2024-05-12T22:52:36.806544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.553977+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:35.553977+0000","last_peered":"2024-05-12T22:52:35.553977+0000","last_clean":"2024-05-12T22:52:35.553977+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:35.553977+0000","last_undegraded":"2024-05-12T22:52:35.553977+0000","last_fullsized":"2024-05-12T22:52:35.553977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:14.936593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284624+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:52:37.284624+0000","last_peered":"2024-05-12T22:52:37.284624+0000","last_clean":"2024-05-12T22:52:37.284624+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:52:37.284624+0000","last_undegraded":"2024-05-12T22:52:37.284624+0000","last_fullsized":"2024-05-12T22:52:37.284624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552899+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:52:36.552899+0000","last_peered":"2024-05-12T22:52:36.552899+0000","last_clean":"2024-05-12T22:52:36.552899+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:52:36.552899+0000","last_undegraded":"2024-05-12T22:52:36.552899+0000","last_fullsized":"2024-05-12T22:52:36.552899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537146+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:35.537146+0000","last_peered":"2024-05-12T22:52:35.537146+0000","last_clean":"2024-05-12T22:52:35.537146+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:35.537146+0000","last_undegraded":"2024-05-12T22:52:35.537146+0000","last_fullsized":"2024-05-12T22:52:35.537146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.558133+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:35.558133+0000","last_peered":"2024-05-12T22:52:35.558133+0000","last_clean":"2024-05-12T22:52:35.558133+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:35.558133+0000","last_undegraded":"2024-05-12T22:52:35.558133+0000","last_fullsized":"2024-05-12T22:52:35.558133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.537529+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:35.537529+0000","last_peered":"2024-05-12T22:52:35.537529+0000","last_clean":"2024-05-12T22:52:35.537529+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:35.537529+0000","last_undegraded":"2024-05-12T22:52:35.537529+0000","last_fullsized":"2024-05-12T22:52:35.537529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.555615+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:35.555615+0000","last_peered":"2024-05-12T22:52:35.555615+0000","last_clean":"2024-05-12T22:52:35.555615+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:35.555615+0000","last_undegraded":"2024-05-12T22:52:35.555615+0000","last_fullsized":"2024-05-12T22:52:35.555615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286053+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:52:37.286053+0000","last_peered":"2024-05-12T22:52:37.286053+0000","last_clean":"2024-05-12T22:52:37.286053+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:52:37.286053+0000","last_undegraded":"2024-05-12T22:52:37.286053+0000","last_fullsized":"2024-05-12T22:52:37.286053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806064+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:52:36.806064+0000","last_peered":"2024-05-12T22:52:36.806064+0000","last_clean":"2024-05-12T22:52:36.806064+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:52:36.806064+0000","last_undegraded":"2024-05-12T22:52:36.806064+0000","last_fullsized":"2024-05-12T22:52:36.806064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555992+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:52:36.555992+0000","last_peered":"2024-05-12T22:52:36.555992+0000","last_clean":"2024-05-12T22:52:36.555992+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:52:36.555992+0000","last_undegraded":"2024-05-12T22:52:36.555992+0000","last_fullsized":"2024-05-12T22:52:36.555992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285271+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:52:37.285271+0000","last_peered":"2024-05-12T22:52:37.285271+0000","last_clean":"2024-05-12T22:52:37.285271+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:52:37.285271+0000","last_undegraded":"2024-05-12T22:52:37.285271+0000","last_fullsized":"2024-05-12T22:52:37.285271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555168+0000","last_change":"2024-05-12T22:52:35.597304+0000","last_active":"2024-05-12T22:52:36.555168+0000","last_peered":"2024-05-12T22:52:36.555168+0000","last_clean":"2024-05-12T22:52:36.555168+0000","last_became_active":"2024-05-12T22:52:35.596833+0000","last_became_peered":"2024-05-12T22:52:35.596833+0000","last_unstale":"2024-05-12T22:52:36.555168+0000","last_undegraded":"2024-05-12T22:52:36.555168+0000","last_fullsized":"2024-05-12T22:52:36.555168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285683+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:52:37.285683+0000","last_peered":"2024-05-12T22:52:37.285683+0000","last_clean":"2024-05-12T22:52:37.285683+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:52:37.285683+0000","last_undegraded":"2024-05-12T22:52:37.285683+0000","last_fullsized":"2024-05-12T22:52:37.285683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.561135+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:35.561135+0000","last_peered":"2024-05-12T22:52:35.561135+0000","last_clean":"2024-05-12T22:52:35.561135+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:35.561135+0000","last_undegraded":"2024-05-12T22:52:35.561135+0000","last_fullsized":"2024-05-12T22:52:35.561135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:47.873600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.551566+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:35.551566+0000","last_peered":"2024-05-12T22:52:35.551566+0000","last_clean":"2024-05-12T22:52:35.551566+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:35.551566+0000","last_undegraded":"2024-05-12T22:52:35.551566+0000","last_fullsized":"2024-05-12T22:52:35.551566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.560815+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:35.560815+0000","last_peered":"2024-05-12T22:52:35.560815+0000","last_clean":"2024-05-12T22:52:35.560815+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:35.560815+0000","last_undegraded":"2024-05-12T22:52:35.560815+0000","last_fullsized":"2024-05-12T22:52:35.560815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-12T22:52:35.591745+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:35.591745+0000","last_peered":"2024-05-12T22:52:35.591745+0000","last_clean":"2024-05-12T22:52:35.591745+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:35.591745+0000","last_undegraded":"2024-05-12T22:52:35.591745+0000","last_fullsized":"2024-05-12T22:52:35.591745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":657251,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":67913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":200704,"data_stored":66391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":72727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":59526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":657307,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:43.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:43.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.171+0000 7f3c40ab7640 1 Processor -- start 2024-05-12T22:52:43.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.171+0000 7f3c40ab7640 1 -- start start 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c40ab7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c40ab7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c3c0b5320 0x7f3c3c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c40ab7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3c0b4b60 con 0x7f3c3c148860 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c40ab7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3c0b61f0 con 0x7f3c3c0b5320 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c40ab7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3c06fb10 con 0x7f3c3c0b5e10 2024-05-12T22:52:43.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3ad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c3c148860 0x7f3c3c13f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51590/0 (socket says 172.21.15.40:51590) 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c3c0b5320 0x7f3c3c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3ad9d640 1 -- 172.21.15.40:0/1191375848 learned_addr learned my addr 172.21.15.40:0/1191375848 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 -- 172.21.15.40:0/1191375848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 msgr2=0x7f3c3c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 -- 172.21.15.40:0/1191375848 >> v1:172.21.15.40:6789/0 conn(0x7f3c3c148860 legacy=0x7f3c3c13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3959a640 1 -- 172.21.15.40:0/1191375848 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123365697 0 0) 0x7f3c3c0b4b60 con 0x7f3c3c148860 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 -- 172.21.15.40:0/1191375848 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c0b4e00 con 0x7f3c3c0b5320 2024-05-12T22:52:43.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:43.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c39d9b640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c0b5320 0x7f3c3c06f460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c300097c0 tx=0x7f3c3001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd368a9c1d55dc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.175+0000 7f3c3959a640 1 -- 172.21.15.40:0/1191375848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c300b0070 con 0x7f3c3c0b5320 2024-05-12T22:52:43.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3959a640 1 -- 172.21.15.40:0/1191375848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c300ab600 con 0x7f3c3c0b5320 2024-05-12T22:52:43.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3959a640 1 -- 172.21.15.40:0/1191375848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c300ab9d0 con 0x7f3c3c0b5320 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/1191375848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c0b5320 msgr2=0x7f3c3c06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c0b5320 0x7f3c3c06f460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c300097c0 tx=0x7f3c3001c410 comp rx=0 tx=0).stop 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/1191375848 shutdown_connections 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c0b5320 0x7f3c3c06f460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/1191375848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/1191375848 >> 172.21.15.40:0/1191375848 conn(0x7f3c3c06b6c0 msgr2=0x7f3c3c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/1191375848 shutdown_connections 2024-05-12T22:52:43.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/1191375848 wait complete. 2024-05-12T22:52:43.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 Processor -- start 2024-05-12T22:52:43.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- start start 2024-05-12T22:52:43.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c148860 0x7f3c3c1376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c152740 con 0x7f3c3c137c20 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c1525c0 con 0x7f3c3c148860 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3c1528c0 con 0x7f3c3c0b5e10 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59890/0 (socket says 172.21.15.40:59890) 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 -- 172.21.15.40:0/545676166 learned_addr learned my addr 172.21.15.40:0/545676166 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c39d9b640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c148860 0x7f3c3c1376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 -- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 msgr2=0x7f3c3c133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 -- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c148860 msgr2=0x7f3c3c1376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c148860 0x7f3c3c1376e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 -- 172.21.15.40:0/545676166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c136f70 con 0x7f3c3c137c20 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c3ad9d640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c34002240 tx=0x7f3c3400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34017070 con 0x7f3c3c137c20 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3400ac30 con 0x7f3c3c137c20 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c137250 con 0x7f3c3c137c20 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34012400 con 0x7f3c3c137c20 2024-05-12T22:52:43.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.179+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c146000 con 0x7f3c3c137c20 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c068330 con 0x7f3c3c137c20 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c3401a070 con 0x7f3c3c137c20 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c2affd640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 0x7f3c1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c34085b10 con 0x7f3c3c137c20 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 0x7f3c1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.183+0000 7f3c3a59c640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 0x7f3c1c069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009980 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.187+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3c340565b0 con 0x7f3c3c137c20 2024-05-12T22:52:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.343+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c3c13d370 con 0x7f3c1c0678c0 2024-05-12T22:52:43.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.355+0000 7f3c2affd640 1 -- 172.21.15.40:0/545676166 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251973 (secure 0 0 0) 0x7f3c3c13d370 con 0x7f3c1c0678c0 2024-05-12T22:52:43.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:43.360 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:43.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 msgr2=0x7f3c1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 0x7f3c1c069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009980 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 msgr2=0x7f3c3c143160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c34002240 tx=0x7f3c3400cf50 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 shutdown_connections 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3c137c20 0x7f3c3c143160 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3c1c0678c0 0x7f3c1c069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c3c148860 0x7f3c3c1376e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 --2- 172.21.15.40:0/545676166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c3c0b5e10 0x7f3c3c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 >> 172.21.15.40:0/545676166 conn(0x7f3c3c06b6c0 msgr2=0x7f3c3c06baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 shutdown_connections 2024-05-12T22:52:43.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.359+0000 7f3c40ab7640 1 -- 172.21.15.40:0/545676166 wait complete. 2024-05-12T22:52:43.377 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-12T22:52:43.347703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234660,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740060,"statfs":{"total":773094113280,"available":772853821440,"internally_reserved":0,"allocated":1867776,"data_stored":1766364,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002383"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286162+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:52:37.286162+0000","last_peered":"2024-05-12T22:52:37.286162+0000","last_clean":"2024-05-12T22:52:37.286162+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:52:37.286162+0000","last_undegraded":"2024-05-12T22:52:37.286162+0000","last_fullsized":"2024-05-12T22:52:37.286162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551378+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:36.551378+0000","last_peered":"2024-05-12T22:52:36.551378+0000","last_clean":"2024-05-12T22:52:36.551378+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:36.551378+0000","last_undegraded":"2024-05-12T22:52:36.551378+0000","last_fullsized":"2024-05-12T22:52:36.551378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286612+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:37.286612+0000","last_peered":"2024-05-12T22:52:37.286612+0000","last_clean":"2024-05-12T22:52:37.286612+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:37.286612+0000","last_undegraded":"2024-05-12T22:52:37.286612+0000","last_fullsized":"2024-05-12T22:52:37.286612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555056+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:52:36.555056+0000","last_peered":"2024-05-12T22:52:36.555056+0000","last_clean":"2024-05-12T22:52:36.555056+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:52:36.555056+0000","last_undegraded":"2024-05-12T22:52:36.555056+0000","last_fullsized":"2024-05-12T22:52:36.555056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285942+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:52:37.285942+0000","last_peered":"2024-05-12T22:52:37.285942+0000","last_clean":"2024-05-12T22:52:37.285942+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:52:37.285942+0000","last_undegraded":"2024-05-12T22:52:37.285942+0000","last_fullsized":"2024-05-12T22:52:37.285942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553561+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:52:36.553561+0000","last_peered":"2024-05-12T22:52:36.553561+0000","last_clean":"2024-05-12T22:52:36.553561+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:52:36.553561+0000","last_undegraded":"2024-05-12T22:52:36.553561+0000","last_fullsized":"2024-05-12T22:52:36.553561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285020+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:52:37.285020+0000","last_peered":"2024-05-12T22:52:37.285020+0000","last_clean":"2024-05-12T22:52:37.285020+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:52:37.285020+0000","last_undegraded":"2024-05-12T22:52:37.285020+0000","last_fullsized":"2024-05-12T22:52:37.285020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285378+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:37.285378+0000","last_peered":"2024-05-12T22:52:37.285378+0000","last_clean":"2024-05-12T22:52:37.285378+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:37.285378+0000","last_undegraded":"2024-05-12T22:52:37.285378+0000","last_fullsized":"2024-05-12T22:52:37.285378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286375+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:52:37.286375+0000","last_peered":"2024-05-12T22:52:37.286375+0000","last_clean":"2024-05-12T22:52:37.286375+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:52:37.286375+0000","last_undegraded":"2024-05-12T22:52:37.286375+0000","last_fullsized":"2024-05-12T22:52:37.286375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806705+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:52:36.806705+0000","last_peered":"2024-05-12T22:52:36.806705+0000","last_clean":"2024-05-12T22:52:36.806705+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:52:36.806705+0000","last_undegraded":"2024-05-12T22:52:36.806705+0000","last_fullsized":"2024-05-12T22:52:36.806705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806145+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:52:36.806145+0000","last_peered":"2024-05-12T22:52:36.806145+0000","last_clean":"2024-05-12T22:52:36.806145+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:52:36.806145+0000","last_undegraded":"2024-05-12T22:52:36.806145+0000","last_fullsized":"2024-05-12T22:52:36.806145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554295+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:52:36.554295+0000","last_peered":"2024-05-12T22:52:36.554295+0000","last_clean":"2024-05-12T22:52:36.554295+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:52:36.554295+0000","last_undegraded":"2024-05-12T22:52:36.554295+0000","last_fullsized":"2024-05-12T22:52:36.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287290+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:37.287290+0000","last_peered":"2024-05-12T22:52:37.287290+0000","last_clean":"2024-05-12T22:52:37.287290+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:37.287290+0000","last_undegraded":"2024-05-12T22:52:37.287290+0000","last_fullsized":"2024-05-12T22:52:37.287290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284847+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:37.284847+0000","last_peered":"2024-05-12T22:52:37.284847+0000","last_clean":"2024-05-12T22:52:37.284847+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:37.284847+0000","last_undegraded":"2024-05-12T22:52:37.284847+0000","last_fullsized":"2024-05-12T22:52:37.284847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550921+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:36.550921+0000","last_peered":"2024-05-12T22:52:36.550921+0000","last_clean":"2024-05-12T22:52:36.550921+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:36.550921+0000","last_undegraded":"2024-05-12T22:52:36.550921+0000","last_fullsized":"2024-05-12T22:52:36.550921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552642+0000","last_change":"2024-05-12T22:52:35.564819+0000","last_active":"2024-05-12T22:52:36.552642+0000","last_peered":"2024-05-12T22:52:36.552642+0000","last_clean":"2024-05-12T22:52:36.552642+0000","last_became_active":"2024-05-12T22:52:35.564023+0000","last_became_peered":"2024-05-12T22:52:35.564023+0000","last_unstale":"2024-05-12T22:52:36.552642+0000","last_undegraded":"2024-05-12T22:52:36.552642+0000","last_fullsized":"2024-05-12T22:52:36.552642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556489+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:52:36.556489+0000","last_peered":"2024-05-12T22:52:36.556489+0000","last_clean":"2024-05-12T22:52:36.556489+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:52:36.556489+0000","last_undegraded":"2024-05-12T22:52:36.556489+0000","last_fullsized":"2024-05-12T22:52:36.556489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987208+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:36.987208+0000","last_peered":"2024-05-12T22:52:36.987208+0000","last_clean":"2024-05-12T22:52:36.987208+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:36.987208+0000","last_undegraded":"2024-05-12T22:52:36.987208+0000","last_fullsized":"2024-05-12T22:52:36.987208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286105+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:52:37.286105+0000","last_peered":"2024-05-12T22:52:37.286105+0000","last_clean":"2024-05-12T22:52:37.286105+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:52:37.286105+0000","last_undegraded":"2024-05-12T22:52:37.286105+0000","last_fullsized":"2024-05-12T22:52:37.286105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806066+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:52:36.806066+0000","last_peered":"2024-05-12T22:52:36.806066+0000","last_clean":"2024-05-12T22:52:36.806066+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:52:36.806066+0000","last_undegraded":"2024-05-12T22:52:36.806066+0000","last_fullsized":"2024-05-12T22:52:36.806066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285172+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:37.285172+0000","last_peered":"2024-05-12T22:52:37.285172+0000","last_clean":"2024-05-12T22:52:37.285172+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:37.285172+0000","last_undegraded":"2024-05-12T22:52:37.285172+0000","last_fullsized":"2024-05-12T22:52:37.285172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555032+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:52:36.555032+0000","last_peered":"2024-05-12T22:52:36.555032+0000","last_clean":"2024-05-12T22:52:36.555032+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:52:36.555032+0000","last_undegraded":"2024-05-12T22:52:36.555032+0000","last_fullsized":"2024-05-12T22:52:36.555032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285332+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:37.285332+0000","last_peered":"2024-05-12T22:52:37.285332+0000","last_clean":"2024-05-12T22:52:37.285332+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:37.285332+0000","last_undegraded":"2024-05-12T22:52:37.285332+0000","last_fullsized":"2024-05-12T22:52:37.285332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552901+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:52:36.552901+0000","last_peered":"2024-05-12T22:52:36.552901+0000","last_clean":"2024-05-12T22:52:36.552901+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:52:36.552901+0000","last_undegraded":"2024-05-12T22:52:36.552901+0000","last_fullsized":"2024-05-12T22:52:36.552901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287121+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:37.287121+0000","last_peered":"2024-05-12T22:52:37.287121+0000","last_clean":"2024-05-12T22:52:37.287121+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:37.287121+0000","last_undegraded":"2024-05-12T22:52:37.287121+0000","last_fullsized":"2024-05-12T22:52:37.287121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806703+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:52:36.806703+0000","last_peered":"2024-05-12T22:52:36.806703+0000","last_clean":"2024-05-12T22:52:36.806703+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:52:36.806703+0000","last_undegraded":"2024-05-12T22:52:36.806703+0000","last_fullsized":"2024-05-12T22:52:36.806703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551505+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:36.551505+0000","last_peered":"2024-05-12T22:52:36.551505+0000","last_clean":"2024-05-12T22:52:36.551505+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:36.551505+0000","last_undegraded":"2024-05-12T22:52:36.551505+0000","last_fullsized":"2024-05-12T22:52:36.551505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286023+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:37.286023+0000","last_peered":"2024-05-12T22:52:37.286023+0000","last_clean":"2024-05-12T22:52:37.286023+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:37.286023+0000","last_undegraded":"2024-05-12T22:52:37.286023+0000","last_fullsized":"2024-05-12T22:52:37.286023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285576+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:37.285576+0000","last_peered":"2024-05-12T22:52:37.285576+0000","last_clean":"2024-05-12T22:52:37.285576+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:37.285576+0000","last_undegraded":"2024-05-12T22:52:37.285576+0000","last_fullsized":"2024-05-12T22:52:37.285576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555256+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:52:36.555256+0000","last_peered":"2024-05-12T22:52:36.555256+0000","last_clean":"2024-05-12T22:52:36.555256+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:52:36.555256+0000","last_undegraded":"2024-05-12T22:52:36.555256+0000","last_fullsized":"2024-05-12T22:52:36.555256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986926+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:36.986926+0000","last_peered":"2024-05-12T22:52:36.986926+0000","last_clean":"2024-05-12T22:52:36.986926+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:36.986926+0000","last_undegraded":"2024-05-12T22:52:36.986926+0000","last_fullsized":"2024-05-12T22:52:36.986926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805653+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:52:36.805653+0000","last_peered":"2024-05-12T22:52:36.805653+0000","last_clean":"2024-05-12T22:52:36.805653+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:52:36.805653+0000","last_undegraded":"2024-05-12T22:52:36.805653+0000","last_fullsized":"2024-05-12T22:52:36.805653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553533+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:52:36.553533+0000","last_peered":"2024-05-12T22:52:36.553533+0000","last_clean":"2024-05-12T22:52:36.553533+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:52:36.553533+0000","last_undegraded":"2024-05-12T22:52:36.553533+0000","last_fullsized":"2024-05-12T22:52:36.553533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287541+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:37.287541+0000","last_peered":"2024-05-12T22:52:37.287541+0000","last_clean":"2024-05-12T22:52:37.287541+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:37.287541+0000","last_undegraded":"2024-05-12T22:52:37.287541+0000","last_fullsized":"2024-05-12T22:52:37.287541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285950+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:37.285950+0000","last_peered":"2024-05-12T22:52:37.285950+0000","last_clean":"2024-05-12T22:52:37.285950+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:37.285950+0000","last_undegraded":"2024-05-12T22:52:37.285950+0000","last_fullsized":"2024-05-12T22:52:37.285950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805673+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:52:36.805673+0000","last_peered":"2024-05-12T22:52:36.805673+0000","last_clean":"2024-05-12T22:52:36.805673+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:52:36.805673+0000","last_undegraded":"2024-05-12T22:52:36.805673+0000","last_fullsized":"2024-05-12T22:52:36.805673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285789+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:37.285789+0000","last_peered":"2024-05-12T22:52:37.285789+0000","last_clean":"2024-05-12T22:52:37.285789+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:37.285789+0000","last_undegraded":"2024-05-12T22:52:37.285789+0000","last_fullsized":"2024-05-12T22:52:37.285789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285786+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:37.285786+0000","last_peered":"2024-05-12T22:52:37.285786+0000","last_clean":"2024-05-12T22:52:37.285786+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:37.285786+0000","last_undegraded":"2024-05-12T22:52:37.285786+0000","last_fullsized":"2024-05-12T22:52:37.285786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553079+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:52:36.553079+0000","last_peered":"2024-05-12T22:52:36.553079+0000","last_clean":"2024-05-12T22:52:36.553079+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:52:36.553079+0000","last_undegraded":"2024-05-12T22:52:36.553079+0000","last_fullsized":"2024-05-12T22:52:36.553079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550955+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:36.550955+0000","last_peered":"2024-05-12T22:52:36.550955+0000","last_clean":"2024-05-12T22:52:36.550955+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:36.550955+0000","last_undegraded":"2024-05-12T22:52:36.550955+0000","last_fullsized":"2024-05-12T22:52:36.550955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806416+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:52:36.806416+0000","last_peered":"2024-05-12T22:52:36.806416+0000","last_clean":"2024-05-12T22:52:36.806416+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:52:36.806416+0000","last_undegraded":"2024-05-12T22:52:36.806416+0000","last_fullsized":"2024-05-12T22:52:36.806416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556220+0000","last_change":"2024-05-12T22:52:35.573997+0000","last_active":"2024-05-12T22:52:36.556220+0000","last_peered":"2024-05-12T22:52:36.556220+0000","last_clean":"2024-05-12T22:52:36.556220+0000","last_became_active":"2024-05-12T22:52:35.573264+0000","last_became_peered":"2024-05-12T22:52:35.573264+0000","last_unstale":"2024-05-12T22:52:36.556220+0000","last_undegraded":"2024-05-12T22:52:36.556220+0000","last_fullsized":"2024-05-12T22:52:36.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556467+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:52:36.556467+0000","last_peered":"2024-05-12T22:52:36.556467+0000","last_clean":"2024-05-12T22:52:36.556467+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:52:36.556467+0000","last_undegraded":"2024-05-12T22:52:36.556467+0000","last_fullsized":"2024-05-12T22:52:36.556467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286491+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:37.286491+0000","last_peered":"2024-05-12T22:52:37.286491+0000","last_clean":"2024-05-12T22:52:37.286491+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:37.286491+0000","last_undegraded":"2024-05-12T22:52:37.286491+0000","last_fullsized":"2024-05-12T22:52:37.286491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551240+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:36.551240+0000","last_peered":"2024-05-12T22:52:36.551240+0000","last_clean":"2024-05-12T22:52:36.551240+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:36.551240+0000","last_undegraded":"2024-05-12T22:52:36.551240+0000","last_fullsized":"2024-05-12T22:52:36.551240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554358+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:52:36.554358+0000","last_peered":"2024-05-12T22:52:36.554358+0000","last_clean":"2024-05-12T22:52:36.554358+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:52:36.554358+0000","last_undegraded":"2024-05-12T22:52:36.554358+0000","last_fullsized":"2024-05-12T22:52:36.554358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805922+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:52:36.805922+0000","last_peered":"2024-05-12T22:52:36.805922+0000","last_clean":"2024-05-12T22:52:36.805922+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:52:36.805922+0000","last_undegraded":"2024-05-12T22:52:36.805922+0000","last_fullsized":"2024-05-12T22:52:36.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285389+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:52:37.285389+0000","last_peered":"2024-05-12T22:52:37.285389+0000","last_clean":"2024-05-12T22:52:37.285389+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:52:37.285389+0000","last_undegraded":"2024-05-12T22:52:37.285389+0000","last_fullsized":"2024-05-12T22:52:37.285389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285931+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:37.285931+0000","last_peered":"2024-05-12T22:52:37.285931+0000","last_clean":"2024-05-12T22:52:37.285931+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:37.285931+0000","last_undegraded":"2024-05-12T22:52:37.285931+0000","last_fullsized":"2024-05-12T22:52:37.285931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285269+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:37.285269+0000","last_peered":"2024-05-12T22:52:37.285269+0000","last_clean":"2024-05-12T22:52:37.285269+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:37.285269+0000","last_undegraded":"2024-05-12T22:52:37.285269+0000","last_fullsized":"2024-05-12T22:52:37.285269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555310+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:52:36.555310+0000","last_peered":"2024-05-12T22:52:36.555310+0000","last_clean":"2024-05-12T22:52:36.555310+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:52:36.555310+0000","last_undegraded":"2024-05-12T22:52:36.555310+0000","last_fullsized":"2024-05-12T22:52:36.555310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285573+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:52:37.285573+0000","last_peered":"2024-05-12T22:52:37.285573+0000","last_clean":"2024-05-12T22:52:37.285573+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:52:37.285573+0000","last_undegraded":"2024-05-12T22:52:37.285573+0000","last_fullsized":"2024-05-12T22:52:37.285573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805974+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:52:36.805974+0000","last_peered":"2024-05-12T22:52:36.805974+0000","last_clean":"2024-05-12T22:52:36.805974+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:52:36.805974+0000","last_undegraded":"2024-05-12T22:52:36.805974+0000","last_fullsized":"2024-05-12T22:52:36.805974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805837+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:52:36.805837+0000","last_peered":"2024-05-12T22:52:36.805837+0000","last_clean":"2024-05-12T22:52:36.805837+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:52:36.805837+0000","last_undegraded":"2024-05-12T22:52:36.805837+0000","last_fullsized":"2024-05-12T22:52:36.805837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986661+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:36.986661+0000","last_peered":"2024-05-12T22:52:36.986661+0000","last_clean":"2024-05-12T22:52:36.986661+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:36.986661+0000","last_undegraded":"2024-05-12T22:52:36.986661+0000","last_fullsized":"2024-05-12T22:52:36.986661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285096+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:52:37.285096+0000","last_peered":"2024-05-12T22:52:37.285096+0000","last_clean":"2024-05-12T22:52:37.285096+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:52:37.285096+0000","last_undegraded":"2024-05-12T22:52:37.285096+0000","last_fullsized":"2024-05-12T22:52:37.285096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554755+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:52:36.554755+0000","last_peered":"2024-05-12T22:52:36.554755+0000","last_clean":"2024-05-12T22:52:36.554755+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:52:36.554755+0000","last_undegraded":"2024-05-12T22:52:36.554755+0000","last_fullsized":"2024-05-12T22:52:36.554755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285734+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:52:37.285734+0000","last_peered":"2024-05-12T22:52:37.285734+0000","last_clean":"2024-05-12T22:52:37.285734+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:52:37.285734+0000","last_undegraded":"2024-05-12T22:52:37.285734+0000","last_fullsized":"2024-05-12T22:52:37.285734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987315+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:36.987315+0000","last_peered":"2024-05-12T22:52:36.987315+0000","last_clean":"2024-05-12T22:52:36.987315+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:36.987315+0000","last_undegraded":"2024-05-12T22:52:36.987315+0000","last_fullsized":"2024-05-12T22:52:36.987315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286529+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:52:37.286529+0000","last_peered":"2024-05-12T22:52:37.286529+0000","last_clean":"2024-05-12T22:52:37.286529+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:52:37.286529+0000","last_undegraded":"2024-05-12T22:52:37.286529+0000","last_fullsized":"2024-05-12T22:52:37.286529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551350+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:36.551350+0000","last_peered":"2024-05-12T22:52:36.551350+0000","last_clean":"2024-05-12T22:52:36.551350+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:36.551350+0000","last_undegraded":"2024-05-12T22:52:36.551350+0000","last_fullsized":"2024-05-12T22:52:36.551350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555376+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:52:36.555376+0000","last_peered":"2024-05-12T22:52:36.555376+0000","last_clean":"2024-05-12T22:52:36.555376+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:52:36.555376+0000","last_undegraded":"2024-05-12T22:52:36.555376+0000","last_fullsized":"2024-05-12T22:52:36.555376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987063+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:36.987063+0000","last_peered":"2024-05-12T22:52:36.987063+0000","last_clean":"2024-05-12T22:52:36.987063+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:36.987063+0000","last_undegraded":"2024-05-12T22:52:36.987063+0000","last_fullsized":"2024-05-12T22:52:36.987063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285638+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:52:37.285638+0000","last_peered":"2024-05-12T22:52:37.285638+0000","last_clean":"2024-05-12T22:52:37.285638+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:52:37.285638+0000","last_undegraded":"2024-05-12T22:52:37.285638+0000","last_fullsized":"2024-05-12T22:52:37.285638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284734+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:37.284734+0000","last_peered":"2024-05-12T22:52:37.284734+0000","last_clean":"2024-05-12T22:52:37.284734+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:37.284734+0000","last_undegraded":"2024-05-12T22:52:37.284734+0000","last_fullsized":"2024-05-12T22:52:37.284734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554095+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:52:36.554095+0000","last_peered":"2024-05-12T22:52:36.554095+0000","last_clean":"2024-05-12T22:52:36.554095+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:52:36.554095+0000","last_undegraded":"2024-05-12T22:52:36.554095+0000","last_fullsized":"2024-05-12T22:52:36.554095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285580+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:37.285580+0000","last_peered":"2024-05-12T22:52:37.285580+0000","last_clean":"2024-05-12T22:52:37.285580+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:37.285580+0000","last_undegraded":"2024-05-12T22:52:37.285580+0000","last_fullsized":"2024-05-12T22:52:37.285580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284582+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:52:37.284582+0000","last_peered":"2024-05-12T22:52:37.284582+0000","last_clean":"2024-05-12T22:52:37.284582+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:52:37.284582+0000","last_undegraded":"2024-05-12T22:52:37.284582+0000","last_fullsized":"2024-05-12T22:52:37.284582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284790+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:37.284790+0000","last_peered":"2024-05-12T22:52:37.284790+0000","last_clean":"2024-05-12T22:52:37.284790+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:37.284790+0000","last_undegraded":"2024-05-12T22:52:37.284790+0000","last_fullsized":"2024-05-12T22:52:37.284790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986949+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:36.986949+0000","last_peered":"2024-05-12T22:52:36.986949+0000","last_clean":"2024-05-12T22:52:36.986949+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:36.986949+0000","last_undegraded":"2024-05-12T22:52:36.986949+0000","last_fullsized":"2024-05-12T22:52:36.986949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550923+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:36.550923+0000","last_peered":"2024-05-12T22:52:36.550923+0000","last_clean":"2024-05-12T22:52:36.550923+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:36.550923+0000","last_undegraded":"2024-05-12T22:52:36.550923+0000","last_fullsized":"2024-05-12T22:52:36.550923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555532+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:52:36.555532+0000","last_peered":"2024-05-12T22:52:36.555532+0000","last_clean":"2024-05-12T22:52:36.555532+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:52:36.555532+0000","last_undegraded":"2024-05-12T22:52:36.555532+0000","last_fullsized":"2024-05-12T22:52:36.555532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553978+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:52:36.553978+0000","last_peered":"2024-05-12T22:52:36.553978+0000","last_clean":"2024-05-12T22:52:36.553978+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:52:36.553978+0000","last_undegraded":"2024-05-12T22:52:36.553978+0000","last_fullsized":"2024-05-12T22:52:36.553978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551249+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:36.551249+0000","last_peered":"2024-05-12T22:52:36.551249+0000","last_clean":"2024-05-12T22:52:36.551249+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:36.551249+0000","last_undegraded":"2024-05-12T22:52:36.551249+0000","last_fullsized":"2024-05-12T22:52:36.551249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556158+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:52:36.556158+0000","last_peered":"2024-05-12T22:52:36.556158+0000","last_clean":"2024-05-12T22:52:36.556158+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:52:36.556158+0000","last_undegraded":"2024-05-12T22:52:36.556158+0000","last_fullsized":"2024-05-12T22:52:36.556158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285916+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:52:37.285916+0000","last_peered":"2024-05-12T22:52:37.285916+0000","last_clean":"2024-05-12T22:52:37.285916+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:52:37.285916+0000","last_undegraded":"2024-05-12T22:52:37.285916+0000","last_fullsized":"2024-05-12T22:52:37.285916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551253+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:36.551253+0000","last_peered":"2024-05-12T22:52:36.551253+0000","last_clean":"2024-05-12T22:52:36.551253+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:36.551253+0000","last_undegraded":"2024-05-12T22:52:36.551253+0000","last_fullsized":"2024-05-12T22:52:36.551253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551448+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:36.551448+0000","last_peered":"2024-05-12T22:52:36.551448+0000","last_clean":"2024-05-12T22:52:36.551448+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:36.551448+0000","last_undegraded":"2024-05-12T22:52:36.551448+0000","last_fullsized":"2024-05-12T22:52:36.551448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287370+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:37.287370+0000","last_peered":"2024-05-12T22:52:37.287370+0000","last_clean":"2024-05-12T22:52:37.287370+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:37.287370+0000","last_undegraded":"2024-05-12T22:52:37.287370+0000","last_fullsized":"2024-05-12T22:52:37.287370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806544+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:52:36.806544+0000","last_peered":"2024-05-12T22:52:36.806544+0000","last_clean":"2024-05-12T22:52:36.806544+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:52:36.806544+0000","last_undegraded":"2024-05-12T22:52:36.806544+0000","last_fullsized":"2024-05-12T22:52:36.806544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284624+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:52:37.284624+0000","last_peered":"2024-05-12T22:52:37.284624+0000","last_clean":"2024-05-12T22:52:37.284624+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:52:37.284624+0000","last_undegraded":"2024-05-12T22:52:37.284624+0000","last_fullsized":"2024-05-12T22:52:37.284624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552899+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:52:36.552899+0000","last_peered":"2024-05-12T22:52:36.552899+0000","last_clean":"2024-05-12T22:52:36.552899+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:52:36.552899+0000","last_undegraded":"2024-05-12T22:52:36.552899+0000","last_fullsized":"2024-05-12T22:52:36.552899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551027+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:36.551027+0000","last_peered":"2024-05-12T22:52:36.551027+0000","last_clean":"2024-05-12T22:52:36.551027+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:36.551027+0000","last_undegraded":"2024-05-12T22:52:36.551027+0000","last_fullsized":"2024-05-12T22:52:36.551027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286426+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:37.286426+0000","last_peered":"2024-05-12T22:52:37.286426+0000","last_clean":"2024-05-12T22:52:37.286426+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:37.286426+0000","last_undegraded":"2024-05-12T22:52:37.286426+0000","last_fullsized":"2024-05-12T22:52:37.286426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551214+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:36.551214+0000","last_peered":"2024-05-12T22:52:36.551214+0000","last_clean":"2024-05-12T22:52:36.551214+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:36.551214+0000","last_undegraded":"2024-05-12T22:52:36.551214+0000","last_fullsized":"2024-05-12T22:52:36.551214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287516+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:37.287516+0000","last_peered":"2024-05-12T22:52:37.287516+0000","last_clean":"2024-05-12T22:52:37.287516+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:37.287516+0000","last_undegraded":"2024-05-12T22:52:37.287516+0000","last_fullsized":"2024-05-12T22:52:37.287516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286053+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:52:37.286053+0000","last_peered":"2024-05-12T22:52:37.286053+0000","last_clean":"2024-05-12T22:52:37.286053+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:52:37.286053+0000","last_undegraded":"2024-05-12T22:52:37.286053+0000","last_fullsized":"2024-05-12T22:52:37.286053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806064+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:52:36.806064+0000","last_peered":"2024-05-12T22:52:36.806064+0000","last_clean":"2024-05-12T22:52:36.806064+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:52:36.806064+0000","last_undegraded":"2024-05-12T22:52:36.806064+0000","last_fullsized":"2024-05-12T22:52:36.806064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555992+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:52:36.555992+0000","last_peered":"2024-05-12T22:52:36.555992+0000","last_clean":"2024-05-12T22:52:36.555992+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:52:36.555992+0000","last_undegraded":"2024-05-12T22:52:36.555992+0000","last_fullsized":"2024-05-12T22:52:36.555992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285271+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:52:37.285271+0000","last_peered":"2024-05-12T22:52:37.285271+0000","last_clean":"2024-05-12T22:52:37.285271+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:52:37.285271+0000","last_undegraded":"2024-05-12T22:52:37.285271+0000","last_fullsized":"2024-05-12T22:52:37.285271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555168+0000","last_change":"2024-05-12T22:52:35.597304+0000","last_active":"2024-05-12T22:52:36.555168+0000","last_peered":"2024-05-12T22:52:36.555168+0000","last_clean":"2024-05-12T22:52:36.555168+0000","last_became_active":"2024-05-12T22:52:35.596833+0000","last_became_peered":"2024-05-12T22:52:35.596833+0000","last_unstale":"2024-05-12T22:52:36.555168+0000","last_undegraded":"2024-05-12T22:52:36.555168+0000","last_fullsized":"2024-05-12T22:52:36.555168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285683+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:52:37.285683+0000","last_peered":"2024-05-12T22:52:37.285683+0000","last_clean":"2024-05-12T22:52:37.285683+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:52:37.285683+0000","last_undegraded":"2024-05-12T22:52:37.285683+0000","last_fullsized":"2024-05-12T22:52:37.285683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286235+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:37.286235+0000","last_peered":"2024-05-12T22:52:37.286235+0000","last_clean":"2024-05-12T22:52:37.286235+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:37.286235+0000","last_undegraded":"2024-05-12T22:52:37.286235+0000","last_fullsized":"2024-05-12T22:52:37.286235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286968+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:37.286968+0000","last_peered":"2024-05-12T22:52:37.286968+0000","last_clean":"2024-05-12T22:52:37.286968+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:37.286968+0000","last_undegraded":"2024-05-12T22:52:37.286968+0000","last_fullsized":"2024-05-12T22:52:37.286968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286636+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:37.286636+0000","last_peered":"2024-05-12T22:52:37.286636+0000","last_clean":"2024-05-12T22:52:37.286636+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:37.286636+0000","last_undegraded":"2024-05-12T22:52:37.286636+0000","last_fullsized":"2024-05-12T22:52:37.286636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":663551,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":72691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":72727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":72601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":663607,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:43.381 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-12T22:52:43.382 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-12T22:52:43.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-12T22:52:43.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-12T22:52:43.382 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-12T22:52:43.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.543+0000 7f65f3eb6640 1 Processor -- start 2024-05-12T22:52:43.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 -- start start 2024-05-12T22:52:43.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65ec147db0 0x7f65ec1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 0x7f65ec151de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ec0bdbe0 con 0x7f65ec0bd800 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f65ec0b6f40 con 0x7f65ec147db0 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f3eb6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec0b56e0 con 0x7f65ec141720 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1c52640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f65ec0bd800 0x7f65ec1476a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47558/0 (socket says 172.21.15.40:47558) 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1c52640 1 -- 172.21.15.40:0/1690876248 learned_addr learned my addr 172.21.15.40:0/1690876248 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:43.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1451640 1 --2- 172.21.15.40:0/1690876248 >> v2:172.21.15.47:3300/0 conn(0x7f65ec147db0 0x7f65ec1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f2453640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 0x7f65ec151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1451640 1 -- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 msgr2=0x7f65ec151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1451640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 0x7f65ec151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1451640 1 -- 172.21.15.40:0/1690876248 >> v1:172.21.15.47:6789/0 conn(0x7f65ec0bd800 legacy=0x7f65ec1476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f1451640 1 -- 172.21.15.40:0/1690876248 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec0b59c0 con 0x7f65ec147db0 2024-05-12T22:52:43.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.547+0000 7f65f2453640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 0x7f65ec151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:43.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f1451640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec147db0 0x7f65ec1411e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0097c0 tx=0x7f65dc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f8b8252e218359 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f0c50640 1 -- 172.21.15.40:0/1690876248 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b0070 con 0x7f65ec147db0 2024-05-12T22:52:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f0c50640 1 -- 172.21.15.40:0/1690876248 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc0ab600 con 0x7f65ec147db0 2024-05-12T22:52:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f0c50640 1 -- 172.21.15.40:0/1690876248 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0ab9d0 con 0x7f65ec147db0 2024-05-12T22:52:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec147db0 msgr2=0x7f65ec1411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec147db0 0x7f65ec1411e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0097c0 tx=0x7f65dc01c380 comp rx=0 tx=0).stop 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- 172.21.15.40:0/1690876248 shutdown_connections 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec141720 0x7f65ec151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/1690876248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec147db0 0x7f65ec1411e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- 172.21.15.40:0/1690876248 >> 172.21.15.40:0/1690876248 conn(0x7f65ec072ff0 msgr2=0x7f65ec0bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- 172.21.15.40:0/1690876248 shutdown_connections 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- 172.21.15.40:0/1690876248 wait complete. 2024-05-12T22:52:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 Processor -- start 2024-05-12T22:52:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- start start 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec0bd800 0x7f65ec140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 0x7f65ec136f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec0b4660 con 0x7f65ec141720 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec0b44e0 con 0x7f65ec1e31b0 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f3eb6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec154b40 con 0x7f65ec0bd800 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f1451640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f1451640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59898/0 (socket says 172.21.15.40:59898) 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.551+0000 7f65f1451640 1 -- 172.21.15.40:0/550207866 learned_addr learned my addr 172.21.15.40:0/550207866 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f2453640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 0x7f65ec136f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1c52640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec0bd800 0x7f65ec140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 -- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec0bd800 msgr2=0x7f65ec140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec0bd800 0x7f65ec140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 -- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 msgr2=0x7f65ec136f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 0x7f65ec136f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 -- 172.21.15.40:0/550207866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec145090 con 0x7f65ec141720 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f2453640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 0x7f65ec136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1451640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0ae040 tx=0x7f65dc019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b0040 con 0x7f65ec141720 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc004030 con 0x7f65ec141720 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec13c750 con 0x7f65ec141720 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc006e20 con 0x7f65ec141720 2024-05-12T22:52:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec1440b0 con 0x7f65ec141720 2024-05-12T22:52:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec068330 con 0x7f65ec141720 2024-05-12T22:52:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65dc003620 con 0x7f65ec141720 2024-05-12T22:52:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f65dc11f9e0 con 0x7f65ec141720 2024-05-12T22:52:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1c52640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.555+0000 7f65f1c52640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 0x7f65d0069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65e80012f0 tx=0x7f65e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.559+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f65dc0b8020 con 0x7f65ec141720 2024-05-12T22:52:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.763+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f65ec1448b0 con 0x7f65ec141720 2024-05-12T22:52:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.767+0000 7f65e27fc640 1 -- 172.21.15.40:0/550207866 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166885 (secure 0 0 0) 0x7f65dc016090 con 0x7f65ec141720 2024-05-12T22:52:43.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 msgr2=0x7f65d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 0x7f65d0069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65e80012f0 tx=0x7f65e8009040 comp rx=0 tx=0).stop 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 msgr2=0x7f65ec144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0ae040 tx=0x7f65dc019120 comp rx=0 tx=0).stop 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 shutdown_connections 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65d00678c0 0x7f65d0069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65ec1e31b0 0x7f65ec136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65ec141720 0x7f65ec144b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 --2- 172.21.15.40:0/550207866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65ec0bd800 0x7f65ec140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 >> 172.21.15.40:0/550207866 conn(0x7f65ec072ff0 msgr2=0x7f65ec0b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 shutdown_connections 2024-05-12T22:52:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.771+0000 7f65f3eb6640 1 -- 172.21.15.40:0/550207866 wait complete. 2024-05-12T22:52:43.787 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1199194677},{"type":"v1","addr":"172.21.15.40:6833","nonce":1199194677}]},"active_addr":"172.21.15.40:6833/1199194677","active_change":"2024-05-12T22:52:15.329682+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":567034838}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":616282172}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3203422529}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1957574005}]}]} 2024-05-12T22:52:43.790 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-12T22:52:43.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-12T22:52:43.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:43.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 Processor -- start 2024-05-12T22:52:43.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 -- start start 2024-05-12T22:52:43.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 0x7fb104148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1040b2c50 0x7fb104148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb10413f050 0x7fb10413f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb10406f990 con 0x7fb1040b2c50 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb10413fa40 con 0x7fb1040b5d70 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb10986b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb1040708b0 con 0x7fb10413f050 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1040b2c50 0x7fb104148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1040b2c50 0x7fb104148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59908/0 (socket says 172.21.15.40:59908) 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 -- 172.21.15.40:0/885239094 learned_addr learned my addr 172.21.15.40:0/885239094 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb102ffd640 1 --2- 172.21.15.40:0/885239094 >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 0x7fb104148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1037fe640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb10413f050 0x7fb10413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 -- 172.21.15.40:0/885239094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb10413f050 msgr2=0x7fb10413f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb10413f050 0x7fb10413f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 -- 172.21.15.40:0/885239094 >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 msgr2=0x7fb104148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 --2- 172.21.15.40:0/885239094 >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 0x7fb104148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 -- 172.21.15.40:0/885239094 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1040b6150 con 0x7fb1040b2c50 2024-05-12T22:52:43.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb102ffd640 1 --2- 172.21.15.40:0/885239094 >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 0x7fb104148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:43.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb1027fc640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1040b2c50 0x7fb104148ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb10406df50 tx=0x7fb0f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc885f22681d89c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb101ffb640 1 -- 172.21.15.40:0/885239094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80a7070 con 0x7fb1040b2c50 2024-05-12T22:52:43.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb101ffb640 1 -- 172.21.15.40:0/885239094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f80b0070 con 0x7fb1040b2c50 2024-05-12T22:52:43.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.903+0000 7fb101ffb640 1 -- 172.21.15.40:0/885239094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80ab890 con 0x7fb1040b2c50 2024-05-12T22:52:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- 172.21.15.40:0/885239094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1040b2c50 msgr2=0x7fb104148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1040b2c50 0x7fb104148ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb10406df50 tx=0x7fb0f801c490 comp rx=0 tx=0).stop 2024-05-12T22:52:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- 172.21.15.40:0/885239094 shutdown_connections 2024-05-12T22:52:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb10413f050 0x7fb10413f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- 172.21.15.40:0/885239094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1040b2c50 0x7fb104148ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- 172.21.15.40:0/885239094 >> v2:172.21.15.47:3300/0 conn(0x7fb1040b5d70 0x7fb104148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- 172.21.15.40:0/885239094 >> 172.21.15.40:0/885239094 conn(0x7fb10406b6c0 msgr2=0x7fb10406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- 172.21.15.40:0/885239094 shutdown_connections 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- 172.21.15.40:0/885239094 wait complete. 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 Processor -- start 2024-05-12T22:52:43.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- start start 2024-05-12T22:52:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 0x7fb1040b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb1040b5d70 0x7fb1040b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040b3fa0 con 0x7fb10413f050 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040b3e20 con 0x7fb1040b2c50 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb10986b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb1040b4120 con 0x7fb1040b5d70 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59922/0 (socket says 172.21.15.40:59922) 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 -- 172.21.15.40:0/136328050 learned_addr learned my addr 172.21.15.40:0/136328050 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb102ffd640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 0x7fb1040b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1027fc640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb1040b5d70 0x7fb1040b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 -- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb1040b5d70 msgr2=0x7fb1040b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb1040b5d70 0x7fb1040b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 -- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 msgr2=0x7fb1040b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 0x7fb1040b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 -- 172.21.15.40:0/136328050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1040b78f0 con 0x7fb10413f050 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb102ffd640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 0x7fb1040b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb1037fe640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc60 tx=0x7fb0fc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0039a0 con 0x7fb10413f050 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc003b40 con 0x7fb10413f050 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.907+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc004020 con 0x7fb10413f050 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1040af380 con 0x7fb10413f050 2024-05-12T22:52:43.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1040b7640 con 0x7fb10413f050 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb104068330 con 0x7fb10413f050 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0fc0041c0 con 0x7fb10413f050 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb0ebfff640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 0x7fb0f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb0fc086070 con 0x7fb10413f050 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb102ffd640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 0x7fb0f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:43.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.911+0000 7fb102ffd640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 0x7fb0f0069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4008930 tx=0x7fb0f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:43.915+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb0fc014030 con 0x7fb10413f050 2024-05-12T22:52:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.079+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb104143bc0 con 0x7fb10413f050 2024-05-12T22:52:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.079+0000 7fb0ebfff640 1 -- 172.21.15.40:0/136328050 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7fb0fc056c40 con 0x7fb10413f050 2024-05-12T22:52:44.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:44.082 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 msgr2=0x7fb0f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 0x7fb0f0069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4008930 tx=0x7fb0f4008040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 msgr2=0x7fb1040adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc60 tx=0x7fb0fc00a5c0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 shutdown_connections 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb10413f050 0x7fb1040adf70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb1040b5d70 0x7fb1040b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb0f00678c0 0x7fb0f0069d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 --2- 172.21.15.40:0/136328050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1040b2c50 0x7fb1040b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 >> 172.21.15.40:0/136328050 conn(0x7fb10406b6c0 msgr2=0x7fb1040710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 shutdown_connections 2024-05-12T22:52:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.083+0000 7fb10986b640 1 -- 172.21.15.40:0/136328050 wait complete. 2024-05-12T22:52:44.101 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-12T22:52:44.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 Processor -- start 2024-05-12T22:52:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 -- start start 2024-05-12T22:52:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f03a00b5d70 0x7f03a0148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03a00b2c50 0x7f03a0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a00b6150 con 0x7f03a013f050 2024-05-12T22:52:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f03a006f990 con 0x7f03a00b2c50 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f03a5368640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f03a00708b0 con 0x7f03a00b5d70 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03a00b2c50 0x7f03a0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f039f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f03a013f050 0x7f03a013f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51596/0 (socket says 172.21.15.40:51596) 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f039f7fe640 1 -- 172.21.15.40:0/3204187886 learned_addr learned my addr 172.21.15.40:0/3204187886 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 -- 172.21.15.40:0/3204187886 >> v2:172.21.15.47:3300/0 conn(0x7f03a00b5d70 msgr2=0x7f03a0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 --2- 172.21.15.40:0/3204187886 >> v2:172.21.15.47:3300/0 conn(0x7f03a00b5d70 0x7f03a0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 -- 172.21.15.40:0/3204187886 >> v1:172.21.15.40:6789/0 conn(0x7f03a013f050 legacy=0x7f03a013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 -- 172.21.15.40:0/3204187886 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a006f620 con 0x7f03a00b2c50 2024-05-12T22:52:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f0397fff640 1 --2- 172.21.15.40:0/3204187886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a0148ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03a006df50 tx=0x7f038801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f460beba2670e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f039e7fc640 1 -- 172.21.15.40:0/3204187886 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880ab610 con 0x7f03a00b2c50 2024-05-12T22:52:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f039e7fc640 1 -- 172.21.15.40:0/3204187886 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880b0070 con 0x7f03a00b2c50 2024-05-12T22:52:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.215+0000 7f039e7fc640 1 -- 172.21.15.40:0/3204187886 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880ab9d0 con 0x7f03a00b2c50 2024-05-12T22:52:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3204187886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 msgr2=0x7f03a0148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- 172.21.15.40:0/3204187886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a0148ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03a006df50 tx=0x7f038801c3f0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3204187886 shutdown_connections 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- 172.21.15.40:0/3204187886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a0148ea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- 172.21.15.40:0/3204187886 >> v2:172.21.15.47:3300/0 conn(0x7f03a00b5d70 0x7f03a0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3204187886 >> 172.21.15.40:0/3204187886 conn(0x7f03a006b6c0 msgr2=0x7f03a006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3204187886 shutdown_connections 2024-05-12T22:52:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3204187886 wait complete. 2024-05-12T22:52:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 Processor -- start 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- start start 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f03a00b5d70 0x7f03a01dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03a013f050 0x7f03a013bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01526f0 con 0x7f03a00b2c50 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0152570 con 0x7f03a013f050 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f03a0152870 con 0x7f03a00b5d70 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59936/0 (socket says 172.21.15.40:59936) 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 -- 172.21.15.40:0/3570822612 learned_addr learned my addr 172.21.15.40:0/3570822612 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 -- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f03a00b5d70 msgr2=0x7f03a01dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039f7fe640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03a013f050 0x7f03a013bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f0397fff640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f03a00b5d70 0x7f03a01dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f03a00b5d70 0x7f03a01dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 -- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03a013f050 msgr2=0x7f03a013bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03a013f050 0x7f03a013bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 -- 172.21.15.40:0/3570822612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a00aa990 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f039effd640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f039000b580 tx=0x7f039000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390014070 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0390010890 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a014f680 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390010c80 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.219+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a00aa6b0 con 0x7f03a00b2c50 2024-05-12T22:52:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a0068330 con 0x7f03a00b2c50 2024-05-12T22:52:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0390017070 con 0x7f03a00b2c50 2024-05-12T22:52:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f03977fe640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 0x7f0380069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0390085af0 con 0x7f03a00b2c50 2024-05-12T22:52:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f0397fff640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 0x7f0380069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.223+0000 7f0397fff640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 0x7f0380069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03880af000 tx=0x7f0388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.227+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f03900565a0 con 0x7f03a00b2c50 2024-05-12T22:52:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.391+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03a00b4010 con 0x7f03a00b2c50 2024-05-12T22:52:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03977fe640 1 -- 172.21.15.40:0/3570822612 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7f0390010e20 con 0x7f03a00b2c50 2024-05-12T22:52:44.394 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 msgr2=0x7f0380069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 0x7f0380069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03880af000 tx=0x7f0388008040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 msgr2=0x7f03a00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f039000b580 tx=0x7f039000ba40 comp rx=0 tx=0).stop 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 shutdown_connections 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f03800678c0 0x7f0380069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03a013f050 0x7f03a013bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f03a00b5d70 0x7f03a01dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 --2- 172.21.15.40:0/3570822612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a00b2c50 0x7f03a00b8a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 >> 172.21.15.40:0/3570822612 conn(0x7f03a006b6c0 msgr2=0x7f03a00b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 shutdown_connections 2024-05-12T22:52:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.395+0000 7f03a5368640 1 -- 172.21.15.40:0/3570822612 wait complete. 2024-05-12T22:52:44.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-12T22:52:44.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-12T22:52:44.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-12T22:52:44.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-12T22:52:44.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-12T22:52:44.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-12T22:52:44.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-12T22:52:44.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-12T22:52:44.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.591+0000 7f0d18b1b640 1 Processor -- start 2024-05-12T22:52:44.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.591+0000 7f0d18b1b640 1 -- start start 2024-05-12T22:52:44.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d18b1b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0d0c036520 0x7f0d0c0d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d18b1b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c029d00 con 0x7f0d0c037030 2024-05-12T22:52:44.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d18b1b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c0362b0 con 0x7f0d0c036c50 2024-05-12T22:52:44.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d18b1b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0c033f40 con 0x7f0d0c036520 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d137fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0d0c036c50 0x7f0d0c033830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47574/0 (socket says 172.21.15.40:47574) 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d137fe640 1 -- 172.21.15.40:0/3584009051 learned_addr learned my addr 172.21.15.40:0/3584009051 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d13fff640 1 --2- 172.21.15.40:0/3584009051 >> v2:172.21.15.40:3300/0 conn(0x7f0d0c036520 0x7f0d0c0d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257526688 0 0) 0x7f0d0c029d00 con 0x7f0d0c037030 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d04003450 con 0x7f0d0c037030 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d13fff640 1 -- 172.21.15.40:0/3584009051 >> v1:172.21.15.47:6789/0 conn(0x7f0d0c036c50 legacy=0x7f0d0c033830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d13fff640 1 -- 172.21.15.40:0/3584009051 >> v1:172.21.15.40:6789/0 conn(0x7f0d0c037030 legacy=0x7f0d0c0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344646633 0 0) 0x7f0d0c0362b0 con 0x7f0d0c036c50 2024-05-12T22:52:44.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7f0d13fff640 1 -- 172.21.15.40:0/3584009051 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0357d0 con 0x7f0d0c036520 2024-05-12T22:52:44.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.595+0000 7fdee29ab640 1 Processor -- start 2024-05-12T22:52:44.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 -- start start 2024-05-12T22:52:44.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d13fff640 1 --2- 172.21.15.40:0/3584009051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036520 0x7f0d0c0d3e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d14064e00 tx=0x7f0d14097d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6ca12799e12c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1412d070 con 0x7f0d0c036520 2024-05-12T22:52:44.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d14120ac0 con 0x7f0d0c036520 2024-05-12T22:52:44.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d127fc640 1 -- 172.21.15.40:0/3584009051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14128440 con 0x7f0d0c036520 2024-05-12T22:52:44.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdedc0b6d30 0x7fdedc14f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc0b7110 con 0x7fdedc072cb0 2024-05-12T22:52:44.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdedc072280 con 0x7fdedc0b6d30 2024-05-12T22:52:44.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdee29ab640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc0724b0 con 0x7fdedc070b80 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdedc0b6d30 0x7fdedc14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdedc0b6d30 0x7fdedc14f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59952/0 (socket says 172.21.15.40:59952) 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 -- 172.21.15.40:0/4294017378 learned_addr learned my addr 172.21.15.40:0/4294017378 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedb7fe640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 Processor -- start 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 -- 172.21.15.40:0/3584009051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036520 msgr2=0x7f0d0c0d3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 --2- 172.21.15.40:0/3584009051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036520 0x7f0d0c0d3e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d14064e00 tx=0x7f0d14097d50 comp rx=0 tx=0).stop 2024-05-12T22:52:44.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 -- 172.21.15.40:0/4294017378 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 msgr2=0x7fdedc145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 -- 172.21.15.40:0/4294017378 >> v1:172.21.15.40:6789/0 conn(0x7fdedc072cb0 legacy=0x7fdedc145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fdedbfff640 1 -- 172.21.15.40:0/4294017378 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc072790 con 0x7fdedc0b6d30 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 -- start start 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 0x7fe2700b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2700b3540 0x7fe270156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2700b55f0 con 0x7fe2700b6f20 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe270145ee0 con 0x7fe2700b1930 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276e07640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe2700b11c0 con 0x7fe2700b3540 2024-05-12T22:52:44.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 -- 172.21.15.40:0/3584009051 shutdown_connections 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 --2- 172.21.15.40:0/3584009051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036520 0x7f0d0c0d3e80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 -- 172.21.15.40:0/3584009051 >> 172.21.15.40:0/3584009051 conn(0x7f0d0c03a890 msgr2=0x7f0d0c03aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 -- 172.21.15.40:0/3584009051 shutdown_connections 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7f0d18b1b640 1 -- 172.21.15.40:0/3584009051 wait complete. 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2700b3540 0x7fe270156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2700b3540 0x7fe270156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50418/0 (socket says 172.21.15.40:50418) 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 -- 172.21.15.40:0/724641480 learned_addr learned my addr 172.21.15.40:0/724641480 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe275604640 1 --2- 172.21.15.40:0/724641480 >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 0x7fe2700b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 -- 172.21.15.40:0/724641480 >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 msgr2=0x7fe2700b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 --2- 172.21.15.40:0/724641480 >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 0x7fe2700b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 -- 172.21.15.40:0/724641480 >> v1:172.21.15.47:6789/0 conn(0x7fe2700b6f20 legacy=0x7fe2701457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdedbfff640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc0b6d30 0x7fdedc14f130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009870 tx=0x7fdec401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2269e0222086cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdedaffd640 1 -- 172.21.15.40:0/4294017378 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec40a7070 con 0x7fdedc0b6d30 2024-05-12T22:52:44.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdedaffd640 1 -- 172.21.15.40:0/4294017378 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec40b0070 con 0x7fdedc0b6d30 2024-05-12T22:52:44.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdedaffd640 1 -- 172.21.15.40:0/4294017378 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec40a7070 con 0x7fdedc0b6d30 2024-05-12T22:52:44.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.599+0000 7fe276606640 1 -- 172.21.15.40:0/724641480 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2700b7300 con 0x7fe2700b3540 2024-05-12T22:52:44.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fe275604640 1 --2- 172.21.15.40:0/724641480 >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 0x7fe2700b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:44.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 Processor -- start 2024-05-12T22:52:44.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- start start 2024-05-12T22:52:44.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- 172.21.15.40:0/4294017378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc0b6d30 msgr2=0x7fdedc14f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc0b6d30 0x7fdedc14f130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009870 tx=0x7fdec401c580 comp rx=0 tx=0).stop 2024-05-12T22:52:44.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- 172.21.15.40:0/4294017378 shutdown_connections 2024-05-12T22:52:44.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 --2- 172.21.15.40:0/4294017378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc0b6d30 0x7fdedc14f130 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009870 tx=0x7fdec401c580 comp rx=0 tx=0).stop 2024-05-12T22:52:44.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- 172.21.15.40:0/4294017378 >> 172.21.15.40:0/4294017378 conn(0x7fdedc06c5a0 msgr2=0x7fdedc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d0c036520 0x7f0d0c0befa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 0x7f0d0c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d0c037030 0x7f0d0c0bf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0d6be0 con 0x7f0d0c036c50 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0c8ca0 con 0x7f0d0c036520 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0d6d60 con 0x7f0d0c037030 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 0x7f0d0c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 0x7f0d0c0c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59980/0 (socket says 172.21.15.40:59980) 2024-05-12T22:52:44.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 -- 172.21.15.40:0/1521167867 learned_addr learned my addr 172.21.15.40:0/1521167867 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d13fff640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d0c037030 0x7f0d0c0bf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- 172.21.15.40:0/4294017378 shutdown_connections 2024-05-12T22:52:44.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- 172.21.15.40:0/4294017378 wait complete. 2024-05-12T22:52:44.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fd725f20640 1 Processor -- start 2024-05-12T22:52:44.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d137fe640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d0c036520 0x7f0d0c0befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fd725f20640 1 -- start start 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 Processor -- start 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 -- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d0c037030 msgr2=0x7f0d0c0bf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d0c037030 0x7f0d0c0bf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 -- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d0c036520 msgr2=0x7f0d0c0befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d0c036520 0x7f0d0c0befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0c1490 con 0x7f0d0c036c50 2024-05-12T22:52:44.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fe276606640 1 --2- 172.21.15.40:0/724641480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b3540 0x7fe270156030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2700b5ea0 tx=0x7fe26801c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5320ef4861f8a053 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 Processor -- start 2024-05-12T22:52:44.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 -- start start 2024-05-12T22:52:44.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d12ffd640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 0x7f0d0c0c4810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800c3e0 tx=0x7f0d0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fe274e03640 1 -- 172.21.15.40:0/724641480 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5590 con 0x7fe2700b3540 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0978035f50 0x7f0978038390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09780eac10 0x7f09780369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0978036330 con 0x7f09780e3d70 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f09780ea780 con 0x7f09780eac10 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0984b9f640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f09780eb070 con 0x7f0978035f50 2024-05-12T22:52:44.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fe274e03640 1 -- 172.21.15.40:0/724641480 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2680a5730 con 0x7fe2700b3540 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fe274e03640 1 -- 172.21.15.40:0/724641480 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5b00 con 0x7fe2700b3540 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f09780e3d70 0x7f09780e41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51630/0 (socket says 172.21.15.40:51630) 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097ffff640 1 -- 172.21.15.40:0/827524951 learned_addr learned my addr 172.21.15.40:0/827524951 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097effd640 1 --2- 172.21.15.40:0/827524951 >> v2:172.21.15.40:3300/0 conn(0x7f09780eac10 0x7f09780369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097e7fc640 1 -- 172.21.15.40:0/827524951 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328811184 0 0) 0x7f0978036330 con 0x7f09780e3d70 2024-05-12T22:52:44.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097e7fc640 1 -- 172.21.15.40:0/827524951 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0970003530 con 0x7f09780e3d70 2024-05-12T22:52:44.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08017070 con 0x7f0d0c036c50 2024-05-12T22:52:44.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d08003600 con 0x7f0d0c036c50 2024-05-12T22:52:44.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08003a30 con 0x7f0d0c036c50 2024-05-12T22:52:44.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 Processor -- start 2024-05-12T22:52:44.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7fdee29ab640 1 -- start start 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f097f7fe640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0978035f50 0x7f0978038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- 172.21.15.40:0/724641480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b3540 msgr2=0x7fe270156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- 172.21.15.40:0/724641480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b3540 0x7fe270156030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2700b5ea0 tx=0x7fe26801c8f0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- 172.21.15.40:0/724641480 shutdown_connections 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- 172.21.15.40:0/724641480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b3540 0x7fe270156030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- 172.21.15.40:0/724641480 >> v2:172.21.15.40:3300/0 conn(0x7fe2700b1930 0x7fe2700b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- 172.21.15.40:0/724641480 >> 172.21.15.40:0/724641480 conn(0x7fe2700ba0b0 msgr2=0x7fe2700b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd725f20640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- 172.21.15.40:0/724641480 shutdown_connections 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd725f20640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7201487f0 0x7fd72013f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c0c1770 con 0x7f0d0c036c50 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c0337a0 con 0x7f0d0c036c50 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc1e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc072cb0 0x7fdedc0adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 0x7fdedc0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0b6680 con 0x7fdedc072cb0 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0b6500 con 0x7fdedc1e8540 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- 172.21.15.40:0/724641480 wait complete. 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 -- start start 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47ec0b24a0 0x7f47ec072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec072d90 0x7f47ec14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec0b5310 con 0x7f47ec06cbf0 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f47ec0b1680 con 0x7f47ec0b24a0 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f2dde640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec06cfd0 con 0x7f47ec072d90 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.603+0000 7f47f0b7a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f47ec06cbf0 0x7f47ec1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51646/0 (socket says 172.21.15.40:51646) 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47f0b7a640 1 -- 172.21.15.40:0/3443973948 learned_addr learned my addr 172.21.15.40:0/3443973948 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd725f20640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7200b8070 con 0x7fd7200b5b10 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56274/0 (socket says 172.21.15.40:56274) 2024-05-12T22:52:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 -- 172.21.15.40:0/1565851198 learned_addr learned my addr 172.21.15.40:0/1565851198 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc158ce0 con 0x7fdedc070b80 2024-05-12T22:52:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca46cb8640 1 Processor -- start 2024-05-12T22:52:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd720149760 con 0x7fd7201487f0 2024-05-12T22:52:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd720072d30 con 0x7fd7200b7c90 2024-05-12T22:52:44.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca46cb8640 1 -- start start 2024-05-12T22:52:44.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d0c0bddb0 con 0x7f0d0c036c50 2024-05-12T22:52:44.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47f137b640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec072d90 0x7f47ec14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 0x7fdedc0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 0x7fdedc0af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50434/0 (socket says 172.21.15.40:50434) 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 -- 172.21.15.40:0/2368896168 learned_addr learned my addr 172.21.15.40:0/2368896168 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdedb7fe640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc072cb0 0x7fdedc0adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdedbfff640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc1e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd71ffff640 1 --2- 172.21.15.40:0/1565851198 >> v2:172.21.15.40:3300/0 conn(0x7fd7201487f0 0x7fd72013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f097effd640 1 -- 172.21.15.40:0/827524951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0978035f50 msgr2=0x7f0978038390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f097effd640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0978035f50 0x7f0978038390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f097effd640 1 -- 172.21.15.40:0/827524951 >> v1:172.21.15.40:6789/0 conn(0x7f09780e3d70 legacy=0x7f09780e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f097effd640 1 -- 172.21.15.40:0/827524951 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0978036ee0 con 0x7f09780eac10 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 -- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 msgr2=0x7fdedc1e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdedc070b80 0x7fdedc1e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 -- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc072cb0 msgr2=0x7fdedc0adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdedc072cb0 0x7fdedc0adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc0b0e60 con 0x7fdedc1e8540 2024-05-12T22:52:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 Processor -- start 2024-05-12T22:52:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 -- 172.21.15.40:0/1565851198 >> v2:172.21.15.40:3300/0 conn(0x7fd7201487f0 msgr2=0x7fd72013f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 --2- 172.21.15.40:0/1565851198 >> v2:172.21.15.40:3300/0 conn(0x7fd7201487f0 0x7fd72013f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 -- 172.21.15.40:0/1565851198 >> v1:172.21.15.40:6789/0 conn(0x7fd7200b5b10 legacy=0x7fd720071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fd724f1e640 1 -- 172.21.15.40:0/1565851198 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd720148c80 con 0x7fd7200b7c90 2024-05-12T22:52:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee0f48640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 0x7fdedc0af900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fded400c760 tx=0x7fded400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- start start 2024-05-12T22:52:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47ebfff640 1 --2- 172.21.15.40:0/3443973948 >> v2:172.21.15.40:3300/0 conn(0x7f47ec0b24a0 0x7f47ec072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4016020 con 0x7fdedc1e8540 2024-05-12T22:52:44.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded4006d80 con 0x7fdedc1e8540 2024-05-12T22:52:44.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4003bc0 con 0x7fdedc1e8540 2024-05-12T22:52:44.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca46cb8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fca40067070 0x7fca401483e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca46cb8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 0x7fe270138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2700b3540 0x7fe270132bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2700b6f20 0x7fe270137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe270157110 con 0x7fe2700b6f20 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe270156f90 con 0x7fe2700b1930 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe276e07640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe270157290 con 0x7fe2700b3540 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca46cb8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca400b8fc0 con 0x7fca400b5240 2024-05-12T22:52:44.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc0b0130 con 0x7fdedc1e8540 2024-05-12T22:52:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe275604640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2700b3540 0x7fe270132bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe275e05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 0x7fe270138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe275e05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 0x7fe270138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50444/0 (socket says 172.21.15.40:50444) 2024-05-12T22:52:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fe275e05640 1 -- 172.21.15.40:0/2466205739 learned_addr learned my addr 172.21.15.40:0/2466205739 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc0b0b80 con 0x7fdedc1e8540 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56302/0 (socket says 172.21.15.40:56302) 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7fca3ffff640 1 -- 172.21.15.40:0/500910473 learned_addr learned my addr 172.21.15.40:0/500910473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fca40147f50 con 0x7fca40067070 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fca40147900 con 0x7fca40067450 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 -- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2700b3540 msgr2=0x7fe270132bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2700b3540 0x7fe270132bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 -- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2700b6f20 msgr2=0x7fe270137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2700b6f20 0x7fe270137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2701497d0 con 0x7fe2700b1930 2024-05-12T22:52:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca44a54640 1 --2- 172.21.15.40:0/500910473 >> v2:172.21.15.47:3300/0 conn(0x7fca40067070 0x7fca401483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdedc148480 con 0x7fdedc1e8540 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d0801a070 con 0x7f0d0c036c50 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0cfffff640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0cf8067940 0x7f0cf8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d080865d0 con 0x7f0d0c036c50 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0cfffff640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7f0cf806fae0 0x7f0cf8071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cf80725b0 con 0x7f0cf806fae0 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0d137fe640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0cf8067940 0x7f0cf8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe275e05640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 0x7fe270138960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe26000c3d0 tx=0x7fe26000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f097effd640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09780eac10 0x7f09780369a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0980000b70 tx=0x7f0980087a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b2b6afaf25983b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47ebfff640 1 -- 172.21.15.40:0/3443973948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec072d90 msgr2=0x7f47ec14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47ebfff640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec072d90 0x7f47ec14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47ebfff640 1 -- 172.21.15.40:0/3443973948 >> v1:172.21.15.40:6789/0 conn(0x7f47ec06cbf0 legacy=0x7f47ec1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260017070 con 0x7fe2700b1930 2024-05-12T22:52:44.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.607+0000 7f47ebfff640 1 -- 172.21.15.40:0/3443973948 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec0b1310 con 0x7f47ec0b24a0 2024-05-12T22:52:44.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2600052f0 con 0x7fe2700b1930 2024-05-12T22:52:44.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260003860 con 0x7fe2700b1930 2024-05-12T22:52:44.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0d13fff640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7f0cf806fae0 0x7f0cf8071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0d137fe640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0cf8067940 0x7f0cf8069e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d00000f70 tx=0x7f0d00007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0d08052ed0 con 0x7f0d0c036c50 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27014a410 con 0x7fe2700b1930 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2701375d0 con 0x7fe2700b1930 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca3ffff640 1 -- 172.21.15.40:0/500910473 >> v2:172.21.15.47:3300/0 conn(0x7fca40067070 msgr2=0x7fca401483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca3ffff640 1 --2- 172.21.15.40:0/500910473 >> v2:172.21.15.47:3300/0 conn(0x7fca40067070 0x7fca401483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca3ffff640 1 -- 172.21.15.40:0/500910473 >> v1:172.21.15.47:6789/0 conn(0x7fca400b5240 legacy=0x7fca400b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fca3ffff640 1 -- 172.21.15.40:0/500910473 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca40147be0 con 0x7fca40067450 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0d13fff640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7f0cf806fae0 0x7f0cf8071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== osd.2 v2:172.21.15.40:6800/931675717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cf80725b0 con 0x7f0cf806fae0 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe27014bb20 con 0x7fe2700b1930 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47ebfff640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec0b24a0 0x7f47ec072850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f47e00087c0 tx=0x7f47e001e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec1bcae67913a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47eb7fe640 1 -- 172.21.15.40:0/3443973948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00ad070 con 0x7f47ec0b24a0 2024-05-12T22:52:44.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47eb7fe640 1 -- 172.21.15.40:0/3443973948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00a7760 con 0x7f47ec0b24a0 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47eb7fe640 1 -- 172.21.15.40:0/3443973948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00a7b30 con 0x7f47ec0b24a0 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 -- 172.21.15.40:0/3443973948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec0b24a0 msgr2=0x7f47ec072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec0b24a0 0x7f47ec072850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f47e00087c0 tx=0x7f47e001e8b0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fd724f1e640 1 --2- 172.21.15.40:0/1565851198 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009870 tx=0x7fd70c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f27680c0ba495da server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f63b219b640 1 Processor -- start 2024-05-12T22:52:44.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f63b219b640 1 -- start start 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 -- 172.21.15.40:0/3443973948 shutdown_connections 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec072d90 0x7f47ec14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 --2- 172.21.15.40:0/3443973948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec0b24a0 0x7f47ec072850 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 -- 172.21.15.40:0/3443973948 >> 172.21.15.40:0/3443973948 conn(0x7f47ec0b8de0 msgr2=0x7f47ec0b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f097e7fc640 1 -- 172.21.15.40:0/827524951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0980110700 con 0x7f09780eac10 2024-05-12T22:52:44.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f097e7fc640 1 -- 172.21.15.40:0/827524951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09801108a0 con 0x7f09780eac10 2024-05-12T22:52:44.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 -- 172.21.15.40:0/3443973948 shutdown_connections 2024-05-12T22:52:44.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f097e7fc640 1 -- 172.21.15.40:0/827524951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0980110cd0 con 0x7f09780eac10 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fd71f7fe640 1 -- 172.21.15.40:0/1565851198 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b1070 con 0x7fd7200b7c90 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fd71f7fe640 1 -- 172.21.15.40:0/1565851198 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0ac620 con 0x7fd7200b7c90 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7fd71f7fe640 1 -- 172.21.15.40:0/1565851198 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0ac9f0 con 0x7fd7200b7c90 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f47f2dde640 1 -- 172.21.15.40:0/3443973948 wait complete. 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.611+0000 7f63b219b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63ac0b7920 0x7f63ac0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63b219b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac0b5ec0 con 0x7f63ac148870 2024-05-12T22:52:44.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 Processor -- start 2024-05-12T22:52:44.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aaffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63ac148870 0x7f63ac0b57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51660/0 (socket says 172.21.15.40:51660) 2024-05-12T22:52:44.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aaffd640 1 -- 172.21.15.40:0/811069750 learned_addr learned my addr 172.21.15.40:0/811069750 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac0b6130 con 0x7f63ac0b4500 2024-05-12T22:52:44.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f63ac148cd0 con 0x7f63ac0b7920 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- 172.21.15.40:0/827524951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09780eac10 msgr2=0x7f09780369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09780eac10 0x7f09780369a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0980000b70 tx=0x7f0980087a10 comp rx=0 tx=0).stop 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- 172.21.15.40:0/827524951 shutdown_connections 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09780eac10 0x7f09780369a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- 172.21.15.40:0/827524951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0978035f50 0x7f0978038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- 172.21.15.40:0/827524951 >> 172.21.15.40:0/827524951 conn(0x7f097803a890 msgr2=0x7f097803aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- 172.21.15.40:0/827524951 shutdown_connections 2024-05-12T22:52:44.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- 172.21.15.40:0/827524951 wait complete. 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 -- start start 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 msgr2=0x7fd7200b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 --2- 172.21.15.40:0/1565851198 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009870 tx=0x7fd70c01c4d0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 shutdown_connections 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 --2- 172.21.15.40:0/1565851198 >> v2:172.21.15.40:3300/0 conn(0x7fd7201487f0 0x7fd72013f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 --2- 172.21.15.40:0/1565851198 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd7200b7c90 0x7fd7200b6050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 >> 172.21.15.40:0/1565851198 conn(0x7fd72006b490 msgr2=0x7fd72006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 shutdown_connections 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe26001a070 con 0x7fe2700b1930 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe2540678c0 0x7fe254069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47ec06cbf0 0x7f47ec06f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec072d90 0x7f47ec13ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec0b24a0 0x7f47ec1e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec0b0290 con 0x7f47ec072d90 2024-05-12T22:52:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec0b0110 con 0x7f47ec06cbf0 2024-05-12T22:52:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f2dde640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec150b30 con 0x7f47ec0b24a0 2024-05-12T22:52:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 Processor -- start 2024-05-12T22:52:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe2600856a0 con 0x7fe2700b1930 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47ebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec072d90 0x7f47ec13ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47ebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec072d90 0x7f47ec13ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60036/0 (socket says 172.21.15.40:60036) 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47ebfff640 1 -- 172.21.15.40:0/115507541 learned_addr learned my addr 172.21.15.40:0/115507541 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7fe25406fac0 0x7fe254071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe260009e50 con 0x7fe25406fac0 2024-05-12T22:52:44.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe260085a50 con 0x7fe2700b1930 2024-05-12T22:52:44.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f0b7a640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47ec06cbf0 0x7f47ec06f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec0b24a0 0x7f47ec1e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- start start 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fded400a850 con 0x7fdedc1e8540 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdebc067990 0x7fdebc069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fded4086500 con 0x7fdedc1e8540 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7fdebc06fc10 0x7fdebc072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fded4017e70 con 0x7fdebc06fc10 2024-05-12T22:52:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fded40868f0 con 0x7fdedc1e8540 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343081310 0 0) 0x7f63ac0b6130 con 0x7f63ac0b4500 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6394003530 con 0x7f63ac0b4500 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> v2:172.21.15.40:3300/0 conn(0x7f63ac0b7920 0x7f63ac0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4279116239 0 0) 0x7f6394003530 con 0x7f63ac0b4500 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 >> v2:172.21.15.40:3300/0 conn(0x7f63ac0b7920 msgr2=0x7f63ac0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 --2- 172.21.15.40:0/811069750 >> v2:172.21.15.40:3300/0 conn(0x7f63ac0b7920 0x7f63ac0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 >> v1:172.21.15.40:6789/0 conn(0x7f63ac148870 legacy=0x7f63ac0b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac0b68e0 con 0x7f63ac0b4500 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f63a4001a00 con 0x7f63ac0b4500 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 >> v1:172.21.15.47:6789/0 conn(0x7f63ac0b4500 legacy=0x7f63ac0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 0x7f6394003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6394004810 0x7f6394004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63940052a0 0x7f63940079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6394008150 con 0x7f6394004810 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6394008300 con 0x7f63940039c0 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f6394008500 con 0x7f63940052a0 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> v2:172.21.15.40:3300/0 conn(0x7f63ac0b7920 0x7f63ac0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63abfff640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63940052a0 0x7f63940079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 0x7f6394003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0978035f50 0x7f09780e9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09780e3d70 0x7f097818e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09780eac10 0x7f09780dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09780f7260 con 0x7f0978035f50 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09780ea0c0 con 0x7f09780eac10 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f0984b9f640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f09780f73e0 con 0x7f09780e3d70 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fdedb7fe640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7fdebc06fc10 0x7fdebc072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fdedbfff640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdebc067990 0x7fdebc069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fdedb7fe640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7fdebc06fc10 0x7fdebc072030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe275604640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe2540678c0 0x7fe254069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fe276606640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7fe25406fac0 0x7fe254071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 -- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47ec06cbf0 msgr2=0x7f47ec06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47ec06cbf0 0x7f47ec06f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 -- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec072d90 msgr2=0x7f47ec13ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47ec072d90 0x7f47ec13ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec13f370 con 0x7f47ec0b24a0 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47f137b640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec0b24a0 0x7f47ec1e77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47e400efc0 tx=0x7f47e400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- 172.21.15.40:0/1565851198 wait complete. 2024-05-12T22:52:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 Processor -- start 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 -- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63940052a0 msgr2=0x7f63940079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63940052a0 0x7f63940079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 -- 172.21.15.40:0/811069750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6394004810 msgr2=0x7f6394004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6394004810 0x7f6394004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63abfff640 1 -- 172.21.15.40:0/811069750 reap_dead start 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f63ab7fe640 1 -- 172.21.15.40:0/811069750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac0b68e0 con 0x7f63940039c0 2024-05-12T22:52:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f097f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0978035f50 0x7f09780e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f097f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0978035f50 0x7f09780e9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60050/0 (socket says 172.21.15.40:60050) 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f097f7fe640 1 -- 172.21.15.40:0/1532387297 learned_addr learned my addr 172.21.15.40:0/1532387297 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f097ffff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09780eac10 0x7f09780dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097effd640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09780e3d70 0x7f097818e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 -- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09780e3d70 msgr2=0x7f097818e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09780e3d70 0x7f097818e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 -- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0978035f50 msgr2=0x7f09780e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0978035f50 0x7f09780e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097803d340 con 0x7f09780eac10 2024-05-12T22:52:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca3ffff640 1 --2- 172.21.15.40:0/500910473 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29732376666e9192 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fdedbfff640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdebc067990 0x7fdebc069e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdec40af000 tx=0x7fdec40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fe275604640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe2540678c0 0x7fe254069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009580 tx=0x7fe26c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4018020 con 0x7f47ec0b24a0 2024-05-12T22:52:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4014480 con 0x7f47ec0b24a0 2024-05-12T22:52:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4014870 con 0x7f47ec0b24a0 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.615+0000 7fd725f20640 1 -- start start 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 0x7fd72013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7200b7c90 0x7fd720140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd720140f80 0x7fd7201f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd720152cc0 con 0x7fd7200b7c90 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd720152b40 con 0x7fd7200b5b10 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd720152e40 con 0x7fd720140f80 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 0x7fd72013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd72571f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd720140f80 0x7fd7201f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 0x7fd72013fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50502/0 (socket says 172.21.15.40:50502) 2024-05-12T22:52:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 -- 172.21.15.40:0/994409750 learned_addr learned my addr 172.21.15.40:0/994409750 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== osd.3 v2:172.21.15.40:6824/2549687319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fded4017e70 con 0x7fdebc06fc10 2024-05-12T22:52:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec0ad420 con 0x7f47ec0b24a0 2024-05-12T22:52:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec0724e0 con 0x7f47ec0b24a0 2024-05-12T22:52:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca3f7fe640 1 -- 172.21.15.40:0/500910473 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40098e90 con 0x7fca40067450 2024-05-12T22:52:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fe276606640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7fe25406fac0 0x7fe254071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47ec068330 con 0x7f47ec0b24a0 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 -- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd720140f80 msgr2=0x7fd7201f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd720140f80 0x7fd7201f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 -- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7200b7c90 msgr2=0x7fd720140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7200b7c90 0x7fd720140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7201428d0 con 0x7fd7200b5b10 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd72571f640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd720140f80 0x7fd7201f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca3f7fe640 1 -- 172.21.15.40:0/500910473 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c0af070 con 0x7fca40067450 2024-05-12T22:52:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f097ffff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09780eac10 0x7f09780dace0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f097400c3e0 tx=0x7f097400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 0x7f6394003dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f639c00dbc0 tx=0x7f639c01c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5a347218e9b7bb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd724f1e640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 0x7fd72013fe50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd70c01a100 tx=0x7fd70c019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00d7c0 con 0x7f63940039c0 2024-05-12T22:52:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c004220 con 0x7f63940039c0 2024-05-12T22:52:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740074e0 con 0x7f09780eac10 2024-05-12T22:52:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09740047f0 con 0x7f09780eac10 2024-05-12T22:52:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974007680 con 0x7f09780eac10 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 msgr2=0x7fca400b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 --2- 172.21.15.40:0/500910473 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c01c4b0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 shutdown_connections 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 --2- 172.21.15.40:0/500910473 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067450 0x7fca400b7d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 --2- 172.21.15.40:0/500910473 >> v2:172.21.15.47:3300/0 conn(0x7fca40067070 0x7fca401483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 >> 172.21.15.40:0/500910473 conn(0x7fca4009c640 msgr2=0x7fca4009ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0bc070 con 0x7fd7200b5b10 2024-05-12T22:52:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0b7430 con 0x7fd7200b5b10 2024-05-12T22:52:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b1040 con 0x7fd7200b5b10 2024-05-12T22:52:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 shutdown_connections 2024-05-12T22:52:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fca46cb8640 1 -- 172.21.15.40:0/500910473 wait complete. 2024-05-12T22:52:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== osd.4 v2:172.21.15.47:6809/1602313510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe260009e50 con 0x7fe25406fac0 2024-05-12T22:52:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd720141e10 con 0x7fd7200b5b10 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd720072520 con 0x7fd7200b5b10 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 msgr2=0x7f6394003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63aa7fc640 1 -- 172.21.15.40:0/811069750 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00d7c0 con 0x7f63940039c0 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63b219b640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 0x7f6394003dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f639c00dbc0 tx=0x7f639c01c5a0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 shutdown_connections 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63b219b640 1 --2- 172.21.15.40:0/811069750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63940039c0 0x7f6394003dc0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f639c00dbc0 tx=0x7f639c01c5a0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 >> 172.21.15.40:0/811069750 conn(0x7f63ac06b2c0 msgr2=0x7f63ac06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.619+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd720071670 con 0x7fd7200b5b10 2024-05-12T22:52:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097803cd80 con 0x7f09780eac10 2024-05-12T22:52:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097803c480 con 0x7f09780eac10 2024-05-12T22:52:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 Processor -- start 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47e401b020 con 0x7f47ec0b24a0 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f47d00678c0 0x7f47d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47e40873c0 con 0x7f47ec0b24a0 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f47d006fac0 0x7f47d0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47d0072590 con 0x7f47d006fac0 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f47e40877b0 con 0x7f47ec0b24a0 2024-05-12T22:52:44.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09780052d0 con 0x7f09780eac10 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47f0b7a640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f47d00678c0 0x7f47d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- start start 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067070 0x7fca40095150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca40067450 0x7fca40149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca400b5240 0x7fca401499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fca400b6ae0 con 0x7fca40067450 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca400b6960 con 0x7fca400b5240 2024-05-12T22:52:44.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fca400b6c60 con 0x7fca40067070 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca44a54640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067070 0x7fca40095150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47ebfff640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f47d006fac0 0x7f47d0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca44a54640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067070 0x7fca40095150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56336/0 (socket says 172.21.15.40:56336) 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca44a54640 1 -- 172.21.15.40:0/3931657839 learned_addr learned my addr 172.21.15.40:0/3931657839 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca45255640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca400b5240 0x7fca401499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca40067450 0x7fca40149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47f0b7a640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f47d00678c0 0x7f47d0069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47ec140c30 tx=0x7f47d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 -- 172.21.15.40:0/3931657839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067070 msgr2=0x7fca40095150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca40067070 0x7fca40095150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 -- 172.21.15.40:0/3931657839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca400b5240 msgr2=0x7fca401499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca400b5240 0x7fca401499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca40146b80 con 0x7fca40067450 2024-05-12T22:52:44.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7f47ebfff640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f47d006fac0 0x7f47d0071ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3ffff640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca40067450 0x7fca40149460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0ab000 tx=0x7fca2c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c003d30 con 0x7fca40067450 2024-05-12T22:52:44.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c0aa470 con 0x7fca40067450 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0aa860 con 0x7fca40067450 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca400ad8c0 con 0x7fca40067450 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca40095e30 con 0x7fca40067450 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd70c0b63d0 con 0x7fd7200b5b10 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd704067940 0x7fd704069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd70c120020 con 0x7fd7200b5b10 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7fd70406fbc0 0x7fd704071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd70c001d40 con 0x7fd70406fbc0 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.623+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd70c120410 con 0x7fd7200b5b10 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fd71ffff640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd704067940 0x7fd704069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca40068a40 con 0x7fca40067450 2024-05-12T22:52:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fd72571f640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7fd70406fbc0 0x7fd704071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== osd.5 v2:172.21.15.47:6808/941811801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47d0072590 con 0x7f47d006fac0 2024-05-12T22:52:44.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 shutdown_connections 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca2c0aaa00 con 0x7fca40067450 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca3d7fa640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fca24067990 0x7fca24069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca2c120b20 con 0x7fca40067450 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca3d7fa640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7fca2406fb30 0x7fca24071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca2c008e50 con 0x7fca2406fb30 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca45255640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7fca2406fb30 0x7fca24071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7f63b219b640 1 -- 172.21.15.40:0/811069750 wait complete. 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca44a54640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fca24067990 0x7fca24069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fca45255640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7fca2406fb30 0x7fca24071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7fca44a54640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fca24067990 0x7fca24069e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca400a8aa0 tx=0x7fca34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== osd.1 v2:172.21.15.40:6816/4284490578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c008e50 con 0x7fca2406fb30 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fd72571f640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7fd70406fbc0 0x7fd704071fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.627+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== osd.6 v2:172.21.15.47:6800/2478742162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd70c001d40 con 0x7fd70406fbc0 2024-05-12T22:52:44.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7fd71ffff640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd704067940 0x7fd704069e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd72013b9e0 tx=0x7fd714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f63b219b640 1 Processor -- start 2024-05-12T22:52:44.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f63b219b640 1 -- start start 2024-05-12T22:52:44.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fca2c0ed320 con 0x7fca40067450 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0974011070 con 0x7f09780eac10 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f09640678c0 0x7f0964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0974085ff0 con 0x7f09780eac10 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7f096406fac0 0x7f0964071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f097400bf30 con 0x7f096406fac0 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f09740863e0 con 0x7f09780eac10 2024-05-12T22:52:44.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f097f7fe640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f09640678c0 0x7f0964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f097effd640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7f096406fac0 0x7f0964071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f097effd640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7f096406fac0 0x7f0964071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f097f7fe640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f09640678c0 0x7f0964069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f096c009c20 tx=0x7f096c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.631+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== osd.0 v2:172.21.15.40:6808/415151301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f097400bf30 con 0x7f096406fac0 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 0x7f63ac1dc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac13b980 0x7f63ac13db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 0x7f63ac1dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 0x7f63ac1dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50506/0 (socket says 172.21.15.40:50506) 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 -- 172.21.15.40:0/2085093136 learned_addr learned my addr 172.21.15.40:0/2085093136 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63ac13d230 0x7f63ac13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac0715a0 con 0x7f63ac13b980 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac06e3e0 con 0x7f63ac13ce50 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f63ac071720 con 0x7f63ac13d230 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63abfff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63ac13d230 0x7f63ac13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 -- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63ac13d230 msgr2=0x7f63ac13c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63ac13d230 0x7f63ac13c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 -- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac13b980 msgr2=0x7f63ac13db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac13b980 0x7f63ac13db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac1ce9f0 con 0x7f63ac13ce50 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63abfff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f63ac13d230 0x7f63ac13c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:44.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.635+0000 7f63ab7fe640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 0x7f63ac1dc850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f639c00dbc0 tx=0x7f639c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 --> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d0c0bddb0 con 0x7f0cf806fae0 2024-05-12T22:52:44.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0cfffff640 1 -- 172.21.15.40:0/1521167867 <== osd.2 v2:172.21.15.40:6800/931675717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d0c0bddb0 con 0x7f0cf806fae0 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7f0cf806fae0 msgr2=0x7f0cf8071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7f0cf806fae0 0x7f0cf8071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0cf8067940 msgr2=0x7f0cf8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0cf8067940 0x7f0cf8069e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d00000f70 tx=0x7f0d00007bc0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 msgr2=0x7f0d0c0c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 --2- 172.21.15.40:0/1521167867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c036c50 0x7f0d0c0c4810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800c3e0 tx=0x7f0d0800c8a0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d13fff640 1 -- 172.21.15.40:0/1521167867 reap_dead start 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 shutdown_connections 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 >> 172.21.15.40:0/1521167867 conn(0x7f0d0c03a890 msgr2=0x7f0d0c0c20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 shutdown_connections 2024-05-12T22:52:44.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.639+0000 7f0d18b1b640 1 -- 172.21.15.40:0/1521167867 wait complete. 2024-05-12T22:52:44.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 --> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47ec0b73c0 con 0x7f47d006fac0 2024-05-12T22:52:44.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47e97fa640 1 -- 172.21.15.40:0/115507541 <== osd.5 v2:172.21.15.47:6808/941811801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f47ec0b73c0 con 0x7f47d006fac0 2024-05-12T22:52:44.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f47d006fac0 msgr2=0x7f47d0071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f47d006fac0 0x7f47d0071ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f47d00678c0 msgr2=0x7f47d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f47d00678c0 0x7f47d0069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47ec140c30 tx=0x7f47d8009040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec0b24a0 msgr2=0x7f47ec1e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 --2- 172.21.15.40:0/115507541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47ec0b24a0 0x7f47ec1e77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47e400efc0 tx=0x7f47e400c490 comp rx=0 tx=0).stop 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f137b640 1 -- 172.21.15.40:0/115507541 reap_dead start 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 shutdown_connections 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 >> 172.21.15.40:0/115507541 conn(0x7f47ec0b8de0 msgr2=0x7f47ec074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 shutdown_connections 2024-05-12T22:52:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.643+0000 7f47f2dde640 1 -- 172.21.15.40:0/115507541 wait complete. 2024-05-12T22:52:44.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 --> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdedc068a40 con 0x7fdebc06fc10 2024-05-12T22:52:44.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c0ba030 con 0x7f63ac13ce50 2024-05-12T22:52:44.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac146110 con 0x7f63ac13ce50 2024-05-12T22:52:44.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac1dc050 con 0x7f63ac13ce50 2024-05-12T22:52:44.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c0043d0 con 0x7f63ac13ce50 2024-05-12T22:52:44.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7fded8ff9640 1 -- 172.21.15.40:0/2368896168 <== osd.3 v2:172.21.15.40:6824/2549687319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdedc068a40 con 0x7fdebc06fc10 2024-05-12T22:52:44.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c003e00 con 0x7f63ac13ce50 2024-05-12T22:52:44.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f638c001040 con 0x7f63ac13ce50 2024-05-12T22:52:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f639c0bd030 con 0x7f63ac13ce50 2024-05-12T22:52:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.647+0000 7f6393fff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6398067990 0x7f6398069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f63aaffd640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6398067990 0x7f6398069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f639c120350 con 0x7f63ac13ce50 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f6393fff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f639806fc10 0x7f6398072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f639c0043d0 con 0x7f639806fc10 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f639c120740 con 0x7f63ac13ce50 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f63abfff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f639806fc10 0x7f6398072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f63aaffd640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6398067990 0x7f6398069e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63ac1e0290 tx=0x7f63a0007a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 --> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2700b5ef0 con 0x7fe25406fac0 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7fdebc06fc10 msgr2=0x7fdebc072030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7fdebc06fc10 0x7fdebc072030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdebc067990 msgr2=0x7fdebc069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdebc067990 0x7fdebc069e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdec40af000 tx=0x7fdec40a7000 comp rx=0 tx=0).stop 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 msgr2=0x7fdedc0af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 --2- 172.21.15.40:0/2368896168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdedc1e8540 0x7fdedc0af900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fded400c760 tx=0x7fded400cc20 comp rx=0 tx=0).stop 2024-05-12T22:52:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f63abfff640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f639806fc10 0x7f6398072030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee0f48640 1 -- 172.21.15.40:0/2368896168 reap_dead start 2024-05-12T22:52:44.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe2667fc640 1 -- 172.21.15.40:0/2466205739 <== osd.4 v2:172.21.15.47:6809/1602313510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2700b5ef0 con 0x7fe25406fac0 2024-05-12T22:52:44.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 shutdown_connections 2024-05-12T22:52:44.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 >> 172.21.15.40:0/2368896168 conn(0x7fdedc06c5a0 msgr2=0x7fdedc0b8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 shutdown_connections 2024-05-12T22:52:44.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fdee29ab640 1 -- 172.21.15.40:0/2368896168 wait complete. 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7fe25406fac0 msgr2=0x7fe254071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7fe25406fac0 0x7fe254071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe2540678c0 msgr2=0x7fe254069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe2540678c0 0x7fe254069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009580 tx=0x7fe26c009190 comp rx=0 tx=0).stop 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 msgr2=0x7fe270138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 --2- 172.21.15.40:0/2466205739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2700b1930 0x7fe270138960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe26000c3d0 tx=0x7fe26000c890 comp rx=0 tx=0).stop 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276606640 1 -- 172.21.15.40:0/2466205739 reap_dead start 2024-05-12T22:52:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 shutdown_connections 2024-05-12T22:52:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 >> 172.21.15.40:0/2466205739 conn(0x7fe2700ba0b0 msgr2=0x7fe27006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 shutdown_connections 2024-05-12T22:52:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7fe276e07640 1 -- 172.21.15.40:0/2466205739 wait complete. 2024-05-12T22:52:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.651+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== osd.7 v2:172.21.15.47:6824/2871462616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f639c0043d0 con 0x7f639806fc10 2024-05-12T22:52:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 --> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca400ad5e0 con 0x7fca2406fb30 2024-05-12T22:52:44.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 --> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09780348f0 con 0x7f096406fac0 2024-05-12T22:52:44.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7fca3d7fa640 1 -- 172.21.15.40:0/3931657839 <== osd.1 v2:172.21.15.40:6816/4284490578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca400ad5e0 con 0x7fca2406fb30 2024-05-12T22:52:44.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f096bfff640 1 -- 172.21.15.40:0/1532387297 <== osd.0 v2:172.21.15.40:6808/415151301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09780348f0 con 0x7f096406fac0 2024-05-12T22:52:44.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7f096406fac0 msgr2=0x7f0964071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7f096406fac0 0x7f0964071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f09640678c0 msgr2=0x7f0964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f09640678c0 0x7f0964069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f096c009c20 tx=0x7f096c009190 comp rx=0 tx=0).stop 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09780eac10 msgr2=0x7f09780dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 --2- 172.21.15.40:0/1532387297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09780eac10 0x7f09780dace0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f097400c3e0 tx=0x7f097400c8a0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f097ffff640 1 -- 172.21.15.40:0/1532387297 reap_dead start 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 shutdown_connections 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 >> 172.21.15.40:0/1532387297 conn(0x7f097803a890 msgr2=0x7f09780f3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 shutdown_connections 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.659+0000 7f0984b9f640 1 -- 172.21.15.40:0/1532387297 wait complete. 2024-05-12T22:52:44.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 --> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd72013e2d0 con 0x7fd70406fbc0 2024-05-12T22:52:44.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd71d7fa640 1 -- 172.21.15.40:0/994409750 <== osd.6 v2:172.21.15.47:6800/2478742162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd72013e2d0 con 0x7fd70406fbc0 2024-05-12T22:52:44.699 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:44.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-12T22:52:44.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7fd70406fbc0 msgr2=0x7fd704071fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7fd70406fbc0 0x7fd704071fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7fca2406fb30 msgr2=0x7fca24071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7fca2406fb30 0x7fca24071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd704067940 msgr2=0x7fd704069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd704067940 0x7fd704069e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd72013b9e0 tx=0x7fd714008040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fca24067990 msgr2=0x7fca24069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fca24067990 0x7fca24069e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca400a8aa0 tx=0x7fca34008040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 msgr2=0x7fd72013fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 --2- 172.21.15.40:0/994409750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7200b5b10 0x7fd72013fe50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd70c01a100 tx=0x7fd70c019270 comp rx=0 tx=0).stop 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd72571f640 1 -- 172.21.15.40:0/994409750 reap_dead start 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 shutdown_connections 2024-05-12T22:52:44.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 >> 172.21.15.40:0/994409750 conn(0x7fd72006b490 msgr2=0x7fd7200baba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca40067450 msgr2=0x7fca40149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 --2- 172.21.15.40:0/3931657839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca40067450 0x7fca40149460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0ab000 tx=0x7fca2c019250 comp rx=0 tx=0).stop 2024-05-12T22:52:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca45255640 1 -- 172.21.15.40:0/3931657839 reap_dead start 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 shutdown_connections 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fd725f20640 1 -- 172.21.15.40:0/994409750 wait complete. 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 shutdown_connections 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 >> 172.21.15.40:0/3931657839 conn(0x7fca4009c640 msgr2=0x7fca4006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 shutdown_connections 2024-05-12T22:52:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.667+0000 7fca46cb8640 1 -- 172.21.15.40:0/3931657839 wait complete. 2024-05-12T22:52:44.705 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-05-12T22:52:44.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-12T22:52:44.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 --> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f638c002de0 con 0x7f639806fc10 2024-05-12T22:52:44.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f6393fff640 1 -- 172.21.15.40:0/2085093136 <== osd.7 v2:172.21.15.47:6824/2871462616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f638c002de0 con 0x7f639806fc10 2024-05-12T22:52:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f639806fc10 msgr2=0x7f6398072030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f639806fc10 0x7f6398072030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6398067990 msgr2=0x7f6398069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6398067990 0x7f6398069e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63ac1e0290 tx=0x7f63a0007a70 comp rx=0 tx=0).stop 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 msgr2=0x7f63ac1dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 --2- 172.21.15.40:0/2085093136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63ac13ce50 0x7f63ac1dc850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f639c00dbc0 tx=0x7f639c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63abfff640 1 -- 172.21.15.40:0/2085093136 reap_dead start 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 shutdown_connections 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 >> 172.21.15.40:0/2085093136 conn(0x7f63ac06b2c0 msgr2=0x7f63ac0b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 shutdown_connections 2024-05-12T22:52:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.683+0000 7f63b219b640 1 -- 172.21.15.40:0/2085093136 wait complete. 2024-05-12T22:52:44.709 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:44.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-12T22:52:44.710 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:44.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-12T22:52:44.711 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-05-12T22:52:44.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-12T22:52:44.712 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:44.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-12T22:52:44.713 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:44.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-12T22:52:44.714 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-05-12T22:52:44.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-12T22:52:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 Processor -- start 2024-05-12T22:52:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 Processor -- start 2024-05-12T22:52:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 -- start start 2024-05-12T22:52:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 -- start start 2024-05-12T22:52:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 Processor -- start 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcbbc0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc146ef0 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc06d920 con 0x7fcbbc06dc80 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc2bed640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0b0c30 con 0x7fcbbc146b10 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc23ec640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcbbc14bbd0 0x7fcbbc14dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51666/0 (socket says 172.21.15.40:51666) 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc23ec640 1 -- 172.21.15.40:0/1595556699 learned_addr learned my addr 172.21.15.40:0/1595556699 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc1beb640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcbbc0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314520191 0 0) 0x7fcbbc146ef0 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba8003530 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9c006dc80 0x7fb9c0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c0072be0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c00b0c30 con 0x7fb9c006dc80 2024-05-12T22:52:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bf59e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c0146ef0 con 0x7fb9c0146b10 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1354563649 0 0) 0x7fcba8003530 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 msgr2=0x7fcbbc0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcbbc0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 >> v1:172.21.15.47:6789/0 conn(0x7fcbbc06dc80 legacy=0x7fcbbc072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc0b08c0 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fcbac004e70 con 0x7fcbbc14bbd0 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 -- start start 2024-05-12T22:52:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9d980aecd0 0x7f9d9814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d9814be00 0x7f9d9814c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9809eca0 con 0x7f9d9814f090 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9814f830 con 0x7f9d9814be00 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9ef7b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9814fb10 con 0x7f9d980aecd0 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9be59c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bdd9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb9c00b84d0 0x7fb9c0143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47606/0 (socket says 172.21.15.40:47606) 2024-05-12T22:52:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bdd9b640 1 -- 172.21.15.40:0/1024920108 learned_addr learned my addr 172.21.15.40:0/1024920108 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 >> v1:172.21.15.40:6789/0 conn(0x7fcbbc14bbd0 legacy=0x7fcbbc14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcba80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcba8003fc0 0x7fcba8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc0b0c30 con 0x7fcba8003fc0 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcba800ffe0 con 0x7fcba8004d50 2024-05-12T22:52:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcba80101e0 con 0x7fcbbc146b10 2024-05-12T22:52:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc13ea640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcba8003fc0 0x7fcba8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bed9d640 1 --2- 172.21.15.40:0/1024920108 >> v2:172.21.15.47:3300/0 conn(0x7fb9c006dc80 0x7fb9c0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9cd17640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9d9814f090 0x7f9d980ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51678/0 (socket says 172.21.15.40:51678) 2024-05-12T22:52:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9cd17640 1 -- 172.21.15.40:0/1850724075 learned_addr learned my addr 172.21.15.40:0/1850724075 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fd20cca1640 1 Processor -- start 2024-05-12T22:52:44.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc1beb640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcba80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fcbc23ec640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d9d518640 1 --2- 172.21.15.40:0/1850724075 >> v2:172.21.15.40:3300/0 conn(0x7f9d9814be00 0x7f9d9814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d97fff640 1 --2- 172.21.15.40:0/1850724075 >> v2:172.21.15.47:3300/0 conn(0x7f9d980aecd0 0x7f9d9814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fd20cca1640 1 -- start start 2024-05-12T22:52:44.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bd59a640 1 -- 172.21.15.40:0/1024920108 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999456267 0 0) 0x7fb9c0072be0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9bd59a640 1 -- 172.21.15.40:0/1024920108 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9a8003530 con 0x7fb9c00b84d0 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d977fe640 1 -- 172.21.15.40:0/1850724075 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942139004 0 0) 0x7f9d9809eca0 con 0x7f9d9814f090 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d977fe640 1 -- 172.21.15.40:0/1850724075 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d88003530 con 0x7f9d9814f090 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d97fff640 1 -- 172.21.15.40:0/1850724075 >> v2:172.21.15.40:3300/0 conn(0x7f9d9814be00 msgr2=0x7f9d9814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d97fff640 1 --2- 172.21.15.40:0/1850724075 >> v2:172.21.15.40:3300/0 conn(0x7f9d9814be00 0x7f9d9814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d97fff640 1 -- 172.21.15.40:0/1850724075 >> v1:172.21.15.40:6789/0 conn(0x7f9d9814f090 legacy=0x7f9d980ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7f9d97fff640 1 -- 172.21.15.40:0/1850724075 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d980afc60 con 0x7f9d980aecd0 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd20cca1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd200008380 0x7fd200039680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd20cca1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2000087e0 0x7fd200039bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd20cca1640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd200036ce0 con 0x7fd200007fa0 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd20cca1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd2000367b0 con 0x7fd200008380 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd20cca1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd200037e70 con 0x7fd2000087e0 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd206ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd200008380 0x7fd200039680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd2077fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd200007fa0 0x7fd2000cc6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47608/0 (socket says 172.21.15.40:47608) 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd2077fe640 1 -- 172.21.15.40:0/84787613 learned_addr learned my addr 172.21.15.40:0/84787613 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd206ffd640 1 -- 172.21.15.40:0/84787613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2000087e0 msgr2=0x7fd200039bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd206ffd640 1 --2- 172.21.15.40:0/84787613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2000087e0 0x7fd200039bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd206ffd640 1 -- 172.21.15.40:0/84787613 >> v1:172.21.15.47:6789/0 conn(0x7fd200007fa0 legacy=0x7fd2000cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fd206ffd640 1 -- 172.21.15.40:0/84787613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd200037b90 con 0x7fd200008380 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 Processor -- start 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 -- start start 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f60036c50 0x7f2f60036520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f60037030 0x7f2f60033830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f60029d00 con 0x7f2f600c8590 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2f60036a60 con 0x7f2f60036c50 2024-05-12T22:52:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f6e284640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2f60035580 con 0x7f2f60037030 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9be59c640 1 -- 172.21.15.40:0/1024920108 >> v2:172.21.15.47:3300/0 conn(0x7fb9c006dc80 msgr2=0x7fb9c0143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9be59c640 1 --2- 172.21.15.40:0/1024920108 >> v2:172.21.15.47:3300/0 conn(0x7fb9c006dc80 0x7fb9c0143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9be59c640 1 -- 172.21.15.40:0/1024920108 >> v1:172.21.15.47:6789/0 conn(0x7fb9c00b84d0 legacy=0x7fb9c0143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.923+0000 7fb9be59c640 1 -- 172.21.15.40:0/1024920108 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c006d920 con 0x7fb9c0146b10 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f60036c50 0x7f2f60036520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f60036c50 0x7f2f60036520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50542/0 (socket says 172.21.15.40:50542) 2024-05-12T22:52:44.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 -- 172.21.15.40:0/3365509387 learned_addr learned my addr 172.21.15.40:0/3365509387 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 -- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 msgr2=0x7fcba80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc146b10 0x7fcba80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 -- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcba8004d50 msgr2=0x7fcba80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcba8004d50 0x7fcba80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 -- 172.21.15.40:0/1595556699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba8003530 con 0x7fcba8003fc0 2024-05-12T22:52:44.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f677fe640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f60037030 0x7f2f60033830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fb9be59c640 1 --2- 172.21.15.40:0/1024920108 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c00b0f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40097c0 tx=0x7fb9b401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f039293eb0ace4e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc13ea640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcba8003fc0 0x7fcba8004810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001760 tx=0x7fcbb801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21f14d964ab1ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 Processor -- start 2024-05-12T22:52:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 -- start start 2024-05-12T22:52:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f9d97fff640 1 --2- 172.21.15.40:0/1850724075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d980678e0 tx=0x7f9d8401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24c6ea9e6bce6b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fb9bd59a640 1 -- 172.21.15.40:0/1024920108 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b0070 con 0x7fb9c0146b10 2024-05-12T22:52:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fb9bd59a640 1 -- 172.21.15.40:0/1024920108 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b40ab600 con 0x7fb9c0146b10 2024-05-12T22:52:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fb9bd59a640 1 -- 172.21.15.40:0/1024920108 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ab9b0 con 0x7fb9c0146b10 2024-05-12T22:52:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8001380 con 0x7fcba8003fc0 2024-05-12T22:52:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc1200eac10 0x7fc120035cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200ea410 con 0x7fc1200e3d70 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc120037a70 con 0x7fc120038390 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc12d6c4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc1200eb0a0 con 0x7fc1200eac10 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc127fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc120038390 0x7fc1200369a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47630/0 (socket says 172.21.15.40:47630) 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fc127fff640 1 -- 172.21.15.40:0/3803144529 learned_addr learned my addr 172.21.15.40:0/3803144529 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd206ffd640 1 --2- 172.21.15.40:0/84787613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200008380 0x7fd200039680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40097c0 tx=0x7fd1f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5af4290b3bd3f10 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d977fe640 1 -- 172.21.15.40:0/1850724075 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d840b0070 con 0x7f9d980aecd0 2024-05-12T22:52:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d977fe640 1 -- 172.21.15.40:0/1850724075 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d840ab600 con 0x7f9d980aecd0 2024-05-12T22:52:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d977fe640 1 -- 172.21.15.40:0/1850724075 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d840ab9d0 con 0x7f9d980aecd0 2024-05-12T22:52:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760652607 0 0) 0x7fc1200ea410 con 0x7fc1200e3d70 2024-05-12T22:52:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc118003530 con 0x7fc1200e3d70 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb80052f0 con 0x7fcba8003fc0 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7fcbc0be9640 1 -- 172.21.15.40:0/1595556699 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8003840 con 0x7fcba8003fc0 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- 172.21.15.40:0/1595556699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcba8003fc0 msgr2=0x7fcba8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 --2- 172.21.15.40:0/1595556699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcba8003fc0 0x7fcba8004810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001760 tx=0x7fcbb801c400 comp rx=0 tx=0).stop 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 -- 172.21.15.40:0/1595556699 reap_dead start 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- 172.21.15.40:0/1595556699 shutdown_connections 2024-05-12T22:52:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- 172.21.15.40:0/1595556699 >> 172.21.15.40:0/1595556699 conn(0x7fcbbc0b69a0 msgr2=0x7fcbbc0b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804299785 0 0) 0x7fc120037a70 con 0x7fc120038390 2024-05-12T22:52:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1200ea410 con 0x7fc120038390 2024-05-12T22:52:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- 172.21.15.40:0/1595556699 shutdown_connections 2024-05-12T22:52:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 -- 172.21.15.40:0/1024920108 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 msgr2=0x7fb9c00b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 --2- 172.21.15.40:0/1024920108 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c00b0f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40097c0 tx=0x7fb9b401c410 comp rx=0 tx=0).stop 2024-05-12T22:52:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- 172.21.15.40:0/1595556699 wait complete. 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1995545217 0 0) 0x7fc118003530 con 0x7fc1200e3d70 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 >> v2:172.21.15.47:3300/0 conn(0x7fc1200eac10 msgr2=0x7fc120035cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 --2- 172.21.15.40:0/3803144529 >> v2:172.21.15.47:3300/0 conn(0x7fc1200eac10 0x7fc120035cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 >> v1:172.21.15.47:6789/0 conn(0x7fc120038390 legacy=0x7fc1200369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1200ea0c0 con 0x7fc1200e3d70 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fc12804fe50 con 0x7fc1200e3d70 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 >> v1:172.21.15.40:6789/0 conn(0x7fc1200e3d70 legacy=0x7fc1200e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 0x7fc118003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc118004810 0x7fc118004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1180051d0 0x7fc11800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc11800c0d0 con 0x7fc118003b50 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc11800c280 con 0x7fc118004810 2024-05-12T22:52:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc11800c480 con 0x7fc1180051d0 2024-05-12T22:52:44.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd2067fc640 1 -- 172.21.15.40:0/84787613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40b0070 con 0x7fd200008380 2024-05-12T22:52:44.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd2067fc640 1 -- 172.21.15.40:0/84787613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f40ab600 con 0x7fd200008380 2024-05-12T22:52:44.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd2067fc640 1 -- 172.21.15.40:0/84787613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40ab9d0 con 0x7fd200008380 2024-05-12T22:52:44.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/1850724075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 msgr2=0x7f9d9814b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- 172.21.15.40:0/1850724075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b8c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d980678e0 tx=0x7f9d8401c3f0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/1850724075 shutdown_connections 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- 172.21.15.40:0/1850724075 >> v2:172.21.15.40:3300/0 conn(0x7f9d9814be00 0x7f9d9814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- 172.21.15.40:0/1850724075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b8c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/1850724075 >> 172.21.15.40:0/1850724075 conn(0x7f9d980b6d50 msgr2=0x7f9d980b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 -- 172.21.15.40:0/1024920108 shutdown_connections 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 --2- 172.21.15.40:0/1024920108 >> v2:172.21.15.47:3300/0 conn(0x7fb9c006dc80 0x7fb9c0143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 --2- 172.21.15.40:0/1024920108 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c00b0f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 0x7fc118003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 -- 172.21.15.40:0/1024920108 >> 172.21.15.40:0/1024920108 conn(0x7fb9c00b69a0 msgr2=0x7fb9c00b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/1850724075 shutdown_connections 2024-05-12T22:52:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/1850724075 wait complete. 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc1277fe640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc118004810 0x7fc118004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 -- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1180051d0 msgr2=0x7fc11800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1180051d0 0x7fc11800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 -- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc118004810 msgr2=0x7fc118004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc118004810 0x7fc118004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc127fff640 1 -- 172.21.15.40:0/3803144529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118003530 con 0x7fc118003b50 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 -- 172.21.15.40:0/84787613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200008380 msgr2=0x7fd200039680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 --2- 172.21.15.40:0/84787613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200008380 0x7fd200039680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40097c0 tx=0x7fd1f401c410 comp rx=0 tx=0).stop 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 -- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f60037030 msgr2=0x7f2f60033830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f60037030 0x7f2f60033830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 -- 172.21.15.40:0/3365509387 >> v1:172.21.15.47:6789/0 conn(0x7f2f600c8590 legacy=0x7f2f600cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.927+0000 7f2f67fff640 1 -- 172.21.15.40:0/3365509387 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f600362b0 con 0x7f2f60036c50 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 Processor -- start 2024-05-12T22:52:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fc12cec3640 1 -- 172.21.15.40:0/3803144529 reap_dead start 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 -- 172.21.15.40:0/84787613 shutdown_connections 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 --2- 172.21.15.40:0/84787613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2000087e0 0x7fd200039bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 --2- 172.21.15.40:0/84787613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200008380 0x7fd200039680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 -- 172.21.15.40:0/84787613 >> 172.21.15.40:0/84787613 conn(0x7fd20003cab0 msgr2=0x7fd20003cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f67fff640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f60036520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f68062ea0 tx=0x7f2f68097dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9936f74bea71c8ac server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 Processor -- start 2024-05-12T22:52:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 -- 172.21.15.40:0/1024920108 shutdown_connections 2024-05-12T22:52:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f66ffd640 1 -- 172.21.15.40:0/3365509387 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6812d070 con 0x7f2f60036c50 2024-05-12T22:52:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- start start 2024-05-12T22:52:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbbc145f00 0x7fcbbc14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f66ffd640 1 -- 172.21.15.40:0/3365509387 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f68120c60 con 0x7f2f60036c50 2024-05-12T22:52:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f66ffd640 1 -- 172.21.15.40:0/3365509387 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68128640 con 0x7f2f60036c50 2024-05-12T22:52:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 0x7fcbbc14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 0x7fcbbc1dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc0b2d70 con 0x7fcbbc145f00 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc072c70 con 0x7fcbbc14ce50 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc2bed640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0b2ef0 con 0x7fcbbc1df860 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 0x7fcbbc1dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc13ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 0x7fcbbc14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc13ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 0x7fcbbc14d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50578/0 (socket says 172.21.15.40:50578) 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc13ea640 1 -- 172.21.15.40:0/107082430 learned_addr learned my addr 172.21.15.40:0/107082430 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fb9bf59e640 1 -- 172.21.15.40:0/1024920108 wait complete. 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- start start 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9814be00 0x7f9d9814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9d98156b80 con 0x7f9d9814be00 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d980b8cd0 con 0x7f9d980aecd0 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9ef7b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9d98156d00 con 0x7f9d9814f090 2024-05-12T22:52:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 -- 172.21.15.40:0/84787613 shutdown_connections 2024-05-12T22:52:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f6e284640 1 -- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 msgr2=0x7f2f60036520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f2f6e284640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f60036520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f68062ea0 tx=0x7f2f68097dd0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fd20cca1640 1 -- 172.21.15.40:0/84787613 wait complete. 2024-05-12T22:52:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9d518640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9cd17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7f9d9d518640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56408/0 (socket says 172.21.15.40:56408) 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 -- 172.21.15.40:0/2590838582 learned_addr learned my addr 172.21.15.40:0/2590838582 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 -- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 msgr2=0x7fcbbc14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 0x7fcbbc14d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 -- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbbc145f00 msgr2=0x7fcbbc14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbbc145f00 0x7fcbbc14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.931+0000 7fcbc23ec640 1 -- 172.21.15.40:0/107082430 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc14e190 con 0x7fcbbc1df860 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbc23ec640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 0x7fcbbc1dfce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc06d710 tx=0x7fcbac010d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 -- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 msgr2=0x7f9d9814b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- 172.21.15.40:0/3365509387 shutdown_connections 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f60037030 0x7f2f60033830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 --2- 172.21.15.40:0/3365509387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f60036520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- 172.21.15.40:0/3365509387 >> 172.21.15.40:0/3365509387 conn(0x7f2f6003a890 msgr2=0x7f2f6003aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 -- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9814be00 msgr2=0x7f9d9814b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9814be00 0x7f9d9814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 -- 172.21.15.40:0/2590838582 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9813f1a0 con 0x7f9d9814f090 2024-05-12T22:52:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00ec50 con 0x7fcbbc1df860 2024-05-12T22:52:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- 172.21.15.40:0/3365509387 shutdown_connections 2024-05-12T22:52:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbc2bed640 1 -- 172.21.15.40:0/107082430 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc1462e0 con 0x7fcbbc1df860 2024-05-12T22:52:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbc2bed640 1 -- 172.21.15.40:0/107082430 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbbc14e460 con 0x7fcbbc1df860 2024-05-12T22:52:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 Processor -- start 2024-05-12T22:52:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fc127fff640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 0x7fc118003f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0019e0 tx=0x7fc11c01c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c42f4004e41183 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c001600 con 0x7fc118003b50 2024-05-12T22:52:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9d518640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000efc0 tx=0x7f9d9000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c004ab0 con 0x7fc118003b50 2024-05-12T22:52:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fc126ffd640 1 -- 172.21.15.40:0/3803144529 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c007070 con 0x7fc118003b50 2024-05-12T22:52:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 Processor -- start 2024-05-12T22:52:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 -- start start 2024-05-12T22:52:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac00ee10 con 0x7fcbbc1df860 2024-05-12T22:52:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac011640 con 0x7fcbbc1df860 2024-05-12T22:52:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fcbc2bed640 1 -- 172.21.15.40:0/107082430 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba40052a0 con 0x7fcbbc1df860 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90018020 con 0x7f9d9814f090 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 -- start start 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 0x7fb9c0070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 0x7fb9c0071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c013e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00b04a0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00b0320 con 0x7fb9c006dc80 2024-05-12T22:52:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bf59e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c00b2d90 con 0x7fb9c0146b10 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 0x7fd2000c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 0x7fd2000c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 0x7fd200168760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000d9910 con 0x7fd200007fa0 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000d9790 con 0x7fd2000087e0 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd20cca1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd2000d9a90 con 0x7fd200008380 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 0x7fd2000c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 0x7fd2000c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60146/0 (socket says 172.21.15.40:60146) 2024-05-12T22:52:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd2077fe640 1 -- 172.21.15.40:0/1800804390 learned_addr learned my addr 172.21.15.40:0/1800804390 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- 172.21.15.40:0/3365509387 wait complete. 2024-05-12T22:52:44.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 Processor -- start 2024-05-12T22:52:44.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9be59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 0x7fb9c0070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9be59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 0x7fb9c0070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50610/0 (socket says 172.21.15.40:50610) 2024-05-12T22:52:44.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9be59c640 1 -- 172.21.15.40:0/2352414631 learned_addr learned my addr 172.21.15.40:0/2352414631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 0x7fb9c0071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 0x7fd200168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd206ffd640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 0x7fd2000c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bed9d640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c013e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 -- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 msgr2=0x7fb9c013e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c013e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 -- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 msgr2=0x7fb9c0070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 0x7fb9c0070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/2590838582 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9813eec0 con 0x7f9d9814f090 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d90014480 con 0x7f9d9814f090 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90014870 con 0x7f9d9814f090 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/2590838582 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9814e650 con 0x7f9d9814f090 2024-05-12T22:52:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fb9bdd9b640 1 -- 172.21.15.40:0/2352414631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c0071fd0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 -- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 msgr2=0x7fd2000c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 0x7fd2000c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 -- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 msgr2=0x7fd2000c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 0x7fd2000c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 -- 172.21.15.40:0/1800804390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2000bfe40 con 0x7fd2000087e0 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd206ffd640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 0x7fd2000c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:44.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/2590838582 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9814dcb0 con 0x7f9d9814f090 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- start start 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f600bb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f600c8590 0x7f2f600bd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60033ef0 con 0x7f2f60037030 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60033d70 con 0x7f2f60036c50 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f6e284640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2f600d5e90 con 0x7f2f600c8590 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60154/0 (socket says 172.21.15.40:60154) 2024-05-12T22:52:44.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7f2f677fe640 1 -- 172.21.15.40:0/3012673090 learned_addr learned my addr 172.21.15.40:0/3012673090 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.935+0000 7fd207fff640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 0x7fd200168760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b3e0 tx=0x7fd1fc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9bdd9b640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 0x7fb9c0071a90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cb90 tx=0x7fb9b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbac0117e0 con 0x7fcbbc1df860 2024-05-12T22:52:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc015020 con 0x7fd2000087e0 2024-05-12T22:52:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0017070 con 0x7fb9c00b84d0 2024-05-12T22:52:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2000c0120 con 0x7fd2000087e0 2024-05-12T22:52:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 -- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f600c8590 msgr2=0x7f2f600bd470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-12T22:52:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2000c06e0 con 0x7fd2000087e0 2024-05-12T22:52:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b000ac30 con 0x7fb9c00b84d0 2024-05-12T22:52:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0012600 con 0x7fb9c00b84d0 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f67fff640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f600bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f600c8590 0x7f2f600bd470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 -- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 msgr2=0x7f2f600bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f600bb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 -- 172.21.15.40:0/3012673090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f600c15a0 con 0x7f2f60037030 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f677fe640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00b7b0 tx=0x7f2f5c00d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fcbb27fc640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 0x7fcba0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcbac086f40 con 0x7fcbbc1df860 2024-05-12T22:52:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fcbc1beb640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 0x7fcba0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc011830 con 0x7fd2000087e0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc011c00 con 0x7fd2000087e0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fcbc1beb640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 0x7fcba0069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40070b0 tx=0x7fcbb4007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9bf59e640 1 -- 172.21.15.40:0/2352414631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c013de90 con 0x7fb9c00b84d0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9bf59e640 1 -- 172.21.15.40:0/2352414631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c01528e0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fb9bf59e640 1 -- 172.21.15.40:0/2352414631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c01410a0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d9001b020 con 0x7f9d9814f090 2024-05-12T22:52:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f9d957fa640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 0x7f9d7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9d90086e80 con 0x7f9d9814f090 2024-05-12T22:52:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f9d9cd17640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 0x7f9d7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 -- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 msgr2=0x7fc118003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 0x7fc118003f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0019e0 tx=0x7fc11c01c660 comp rx=0 tx=0).stop 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 -- 172.21.15.40:0/3803144529 shutdown_connections 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/3803144529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc118003b50 0x7fc118003f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 -- 172.21.15.40:0/3803144529 >> 172.21.15.40:0/3803144529 conn(0x7fc12003a890 msgr2=0x7fc12003aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 -- 172.21.15.40:0/3803144529 shutdown_connections 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fc12d6c4640 1 -- 172.21.15.40:0/3803144529 wait complete. 2024-05-12T22:52:44.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f9d9cd17640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 0x7f9d7c069db0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0011f0 tx=0x7f9d8c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fdcd0ef1640 1 Processor -- start 2024-05-12T22:52:44.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fdcd0ef1640 1 -- start start 2024-05-12T22:52:44.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e80052a0 con 0x7fd2000087e0 2024-05-12T22:52:44.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1fc018020 con 0x7fd2000087e0 2024-05-12T22:52:44.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fd1f3fff640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 0x7fd1ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd1fc085890 con 0x7fd2000087e0 2024-05-12T22:52:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fd2077fe640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 0x7fd1ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcd0ef1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdccc144000 0x7fdccc1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fd2077fe640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 0x7fd1ec069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd20806a8f0 tx=0x7fd2080690b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcd0ef1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc072d70 con 0x7fdccc144d10 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcd0ef1640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc06da20 con 0x7fdccc06d640 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcd0ef1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc0b3d10 con 0x7fdccc144000 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9b001a070 con 0x7fb9c00b84d0 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fb9aeffd640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b0085da0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fb9be59c640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fb9be59c640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 0x7fb9a0069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401a040 tx=0x7fb9b40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 Processor -- start 2024-05-12T22:52:44.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 -- start start 2024-05-12T22:52:44.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcca59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdccc06d640 0x7fdccc071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47644/0 (socket says 172.21.15.40:47644) 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcca59c640 1 -- 172.21.15.40:0/2536922666 learned_addr learned my addr 172.21.15.40:0/2536922666 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00ddd0 con 0x7f2f60037030 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c01b070 con 0x7f2f60037030 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c016610 con 0x7f2f60037030 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f6e284640 1 -- 172.21.15.40:0/3012673090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f600c1840 con 0x7f2f60037030 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f6e284640 1 -- 172.21.15.40:0/3012673090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f600bedd0 con 0x7f2f60037030 2024-05-12T22:52:44.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.939+0000 7f2f6e284640 1 -- 172.21.15.40:0/3012673090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f600052d0 con 0x7f2f60037030 2024-05-12T22:52:44.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/2536922666 >> v2:172.21.15.40:3300/0 conn(0x7fdccc144000 0x7fdccc1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc127fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc127fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56444/0 (socket says 172.21.15.40:56444) 2024-05-12T22:52:44.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7f590d39b640 1 Processor -- start 2024-05-12T22:52:44.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7f590d39b640 1 -- start start 2024-05-12T22:52:44.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcc3fff640 1 -- 172.21.15.40:0/2536922666 >> v1:172.21.15.47:6789/0 conn(0x7fdccc06d640 legacy=0x7fdccc071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcc3fff640 1 -- 172.21.15.40:0/2536922666 >> v1:172.21.15.40:6789/0 conn(0x7fdccc144d10 legacy=0x7fdccc14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fdcc3fff640 1 -- 172.21.15.40:0/2536922666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0b5a60 con 0x7fdccc144000 2024-05-12T22:52:44.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59080b7c90 0x7f59080b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59081487f0 0x7f590813f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f590813f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5908149760 con 0x7f59081487f0 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5908072d30 con 0x7f59080b7c90 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590d39b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f59080b8070 con 0x7f59080b5b10 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59080b7c90 0x7f59080b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59080b7c90 0x7f59080b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50650/0 (socket says 172.21.15.40:50650) 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f590cb9a640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f590813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 -- 172.21.15.40:0/4052376624 learned_addr learned my addr 172.21.15.40:0/4052376624 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 -- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 msgr2=0x7f590813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f590813f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 -- 172.21.15.40:0/4052376624 >> v2:172.21.15.40:3300/0 conn(0x7f59081487f0 msgr2=0x7f590813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 --2- 172.21.15.40:0/4052376624 >> v2:172.21.15.40:3300/0 conn(0x7f59081487f0 0x7f590813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7f5907fff640 1 -- 172.21.15.40:0/4052376624 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5908148c80 con 0x7f59080b7c90 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1200f0ee0 0x7fc1200dad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200e4520 con 0x7fc1200f5780 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200e43a0 con 0x7fc1200f0ee0 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.943+0000 7fc12d6c4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc1200e46a0 con 0x7fc118003b50 2024-05-12T22:52:44.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60172/0 (socket says 172.21.15.40:60172) 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 -- 172.21.15.40:0/358418467 learned_addr learned my addr 172.21.15.40:0/358418467 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc12cec3640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1200f0ee0 0x7fc1200dad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 -- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 msgr2=0x7fc1200f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 -- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1200f0ee0 msgr2=0x7fc1200dad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1200f0ee0 0x7fc1200dad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 -- 172.21.15.40:0/358418467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1200ef840 con 0x7fc1200f5780 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc1277fe640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc11400d800 tx=0x7fc11400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fc127fff640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-12T22:52:44.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/2536922666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc144000 0x7fdccc1447d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0b3e90 tx=0x7fdcb401ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d597aa3e59f89d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb9c01410a0 con 0x7fb9c00b84d0 2024-05-12T22:52:44.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.947+0000 7fdcc9d9b640 1 -- 172.21.15.40:0/2536922666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40b4070 con 0x7fdccc144000 2024-05-12T22:52:44.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fdcc9d9b640 1 -- 172.21.15.40:0/2536922666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb40a7820 con 0x7fdccc144000 2024-05-12T22:52:44.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fdcc9d9b640 1 -- 172.21.15.40:0/2536922666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40a7bf0 con 0x7fdccc144000 2024-05-12T22:52:44.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/2536922666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc144000 msgr2=0x7fdccc1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/2536922666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc144000 0x7fdccc1447d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0b3e90 tx=0x7fdcb401ea50 comp rx=0 tx=0).stop 2024-05-12T22:52:44.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114018020 con 0x7fc1200f5780 2024-05-12T22:52:44.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11400de50 con 0x7fc1200f5780 2024-05-12T22:52:44.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140098e0 con 0x7fc1200f5780 2024-05-12T22:52:44.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1200f0400 con 0x7fc1200f5780 2024-05-12T22:52:44.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1200f09c0 con 0x7fc1200f5780 2024-05-12T22:52:44.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fcbac0575a0 con 0x7fcbbc1df860 2024-05-12T22:52:44.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f5c0167b0 con 0x7f2f60037030 2024-05-12T22:52:44.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1200f5070 con 0x7fc1200f5780 2024-05-12T22:52:44.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7f2f64ff9640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 0x7f2f4c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2f5c0869b0 con 0x7f2f60037030 2024-05-12T22:52:44.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7f2f67fff640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 0x7f2f4c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.951+0000 7f2f67fff640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 0x7f2f4c069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f60039ed0 tx=0x7f2f68075240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/2536922666 shutdown_connections 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/2536922666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc144000 0x7fdccc1447d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/2536922666 >> 172.21.15.40:0/2536922666 conn(0x7fdccc0ba690 msgr2=0x7fdccc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/2536922666 shutdown_connections 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/2536922666 wait complete. 2024-05-12T22:52:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f5907fff640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f59080b6050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59080bab40 tx=0x7f58f801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cabe831e1836593 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 Processor -- start 2024-05-12T22:52:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- start start 2024-05-12T22:52:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f5906ffd640 1 -- 172.21.15.40:0/4052376624 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80b0070 con 0x7f59080b7c90 2024-05-12T22:52:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f5906ffd640 1 -- 172.21.15.40:0/4052376624 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f80ab600 con 0x7f59080b7c90 2024-05-12T22:52:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f5906ffd640 1 -- 172.21.15.40:0/4052376624 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80ab9d0 con 0x7f59080b7c90 2024-05-12T22:52:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd1fc01f020 con 0x7fd2000087e0 2024-05-12T22:52:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2f5c024020 con 0x7f2f60037030 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 0x7fdccc146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc144d10 0x7fdccc14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc06bad0 con 0x7fdccc06d640 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc070eb0 con 0x7fdccc144d10 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcd0ef1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc06bc50 con 0x7fdccc144000 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60204/0 (socket says 172.21.15.40:60204) 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 -- 172.21.15.40:0/295440948 learned_addr learned my addr 172.21.15.40:0/295440948 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 0x7fdccc146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdccad9d640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc144d10 0x7fdccc14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:44.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 -- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 msgr2=0x7f59080b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:44.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f59080b6050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59080bab40 tx=0x7f58f801c490 comp rx=0 tx=0).stop 2024-05-12T22:52:44.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 -- 172.21.15.40:0/4052376624 shutdown_connections 2024-05-12T22:52:44.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f590813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:44.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 --2- 172.21.15.40:0/4052376624 >> v2:172.21.15.40:3300/0 conn(0x7f59081487f0 0x7f590813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 --2- 172.21.15.40:0/4052376624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f59080b6050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7f590d39b640 1 -- 172.21.15.40:0/4052376624 >> 172.21.15.40:0/4052376624 conn(0x7f590806b490 msgr2=0x7f590806b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 -- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 msgr2=0x7fdccc146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 0x7fdccc146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 -- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc144d10 msgr2=0x7fdccc14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc144d10 0x7fdccc14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcca59c640 1 -- 172.21.15.40:0/295440948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1e7980 con 0x7fdccc06d640 2024-05-12T22:52:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.955+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 0x7fdccc146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- 172.21.15.40:0/4052376624 shutdown_connections 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- 172.21.15.40:0/4052376624 wait complete. 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fdcca59c640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00c500 tx=0x7fdcbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc017070 con 0x7fdccc06d640 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc1e7c60 con 0x7fdccc06d640 2024-05-12T22:52:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1e7460 con 0x7fdccc06d640 2024-05-12T22:52:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc11401b020 con 0x7fc1200f5780 2024-05-12T22:52:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 Processor -- start 2024-05-12T22:52:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- start start 2024-05-12T22:52:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fc124ff9640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 0x7fc10c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc114086220 con 0x7fc1200f5780 2024-05-12T22:52:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f59081451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5908144130 0x7f5908142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5908071cd0 con 0x7f5908144130 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5908071b50 con 0x7f59080b7c90 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f590d39b640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f5908071e50 con 0x7f59080b5b10 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f5907fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f59081451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.959+0000 7f59077fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50664/0 (socket says 172.21.15.40:50664) 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 -- 172.21.15.40:0/1348506937 learned_addr learned my addr 172.21.15.40:0/1348506937 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f590cb9a640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5908144130 0x7f5908142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc1e7750 con 0x7fdccc06d640 2024-05-12T22:52:45.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 -- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 msgr2=0x7f59081451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f59081451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 -- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5908144130 msgr2=0x7f5908142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5908144130 0x7f5908142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 -- 172.21.15.40:0/1348506937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59081dc370 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f59077fe640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b410 tx=0x7f58fc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc015020 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc011830 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc011c20 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59081dc650 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590813fc30 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59080ae510 con 0x7f59080b7c90 2024-05-12T22:52:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.963+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9d90022070 con 0x7f9d9814f090 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7fc127fff640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 0x7fc10c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7fc127fff640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 0x7fc10c069e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0aa000 tx=0x7fc11c001350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58fc018020 con 0x7f59080b7c90 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7f5904ff9640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58fc086120 con 0x7f59080b7c90 2024-05-12T22:52:45.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7f5907fff640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.967+0000 7f5907fff640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 0x7f58f4069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:45.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.971+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc1200f5070 con 0x7fc1200f5780 2024-05-12T22:52:45.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.971+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcbc005cf0 con 0x7fdccc06d640 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.975+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc021060 con 0x7fdccc06d640 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.975+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcbc01a070 con 0x7fdccc06d640 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.975+0000 7fdcc2ffd640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 0x7fdcac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.975+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdcbc085550 con 0x7fdccc06d640 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.975+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 0x7fdcac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.979+0000 7fdcc3fff640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 0x7fdcac069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40b1000 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.979+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f58fc01f020 con 0x7f59080b7c90 2024-05-12T22:52:45.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:44.983+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdcbc055a10 con 0x7fdccc06d640 2024-05-12T22:52:45.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.263+0000 7fb9bf59e640 1 -- 172.21.15.40:0/2352414631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb9c00710a0 con 0x7fb9c00b84d0 2024-05-12T22:52:45.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.267+0000 7fb9aeffd640 1 -- 172.21.15.40:0/2352414631 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9c0071fd0 con 0x7fb9c00b84d0 2024-05-12T22:52:45.269 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-05-12T22:52:45.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 msgr2=0x7fb9a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 0x7fb9a0069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401a040 tx=0x7fb9b40a6000 comp rx=0 tx=0).stop 2024-05-12T22:52:45.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 msgr2=0x7fb9c0071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 0x7fb9c0071a90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cb90 tx=0x7fb9b000cf90 comp rx=0 tx=0).stop 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 shutdown_connections 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb9c0146b10 0x7fb9c013e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c00b84d0 0x7fb9c0071a90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 --2- 172.21.15.40:0/2352414631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c006dc80 0x7fb9c0070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 >> 172.21.15.40:0/2352414631 conn(0x7fb9c00b69a0 msgr2=0x7fb9c00b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 shutdown_connections 2024-05-12T22:52:45.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fb9acff9640 1 -- 172.21.15.40:0/2352414631 wait complete. 2024-05-12T22:52:45.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fcbc2bed640 1 -- 172.21.15.40:0/107082430 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcba4005860 con 0x7fcbbc1df860 2024-05-12T22:52:45.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.271+0000 7fcbb27fc640 1 -- 172.21.15.40:0/107082430 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcbac05b8a0 con 0x7fcbbc1df860 2024-05-12T22:52:45.274 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-05-12T22:52:45.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 msgr2=0x7fcba0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 0x7fcba0069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40070b0 tx=0x7fcbb4007040 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 msgr2=0x7fcbbc1dfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 0x7fcbbc1dfce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc06d710 tx=0x7fcbac010d50 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 shutdown_connections 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcbbc1df860 0x7fcbbc1dfce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fcba00678c0 0x7fcba0069d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbbc14ce50 0x7fcbbc14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 --2- 172.21.15.40:0/107082430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbbc145f00 0x7fcbbc14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 >> 172.21.15.40:0/107082430 conn(0x7fcbbc0b69a0 msgr2=0x7fcbbc0b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 shutdown_connections 2024-05-12T22:52:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.275+0000 7fcb9ffff640 1 -- 172.21.15.40:0/107082430 wait complete. 2024-05-12T22:52:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.283+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd1e8005860 con 0x7fd2000087e0 2024-05-12T22:52:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.283+0000 7fd1f3fff640 1 -- 172.21.15.40:0/1800804390 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1fc055e10 con 0x7fd2000087e0 2024-05-12T22:52:45.283 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-05-12T22:52:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7f2f6e284640 1 -- 172.21.15.40:0/3012673090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2f600c1370 con 0x7f2f60037030 2024-05-12T22:52:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7f2f64ff9640 1 -- 172.21.15.40:0/3012673090 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f5c057560 con 0x7f2f60037030 2024-05-12T22:52:45.287 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 msgr2=0x7fd1ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 0x7fd1ec069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd20806a8f0 tx=0x7fd2080690b0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 msgr2=0x7fd200168760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 0x7fd200168760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b3e0 tx=0x7fd1fc009f90 comp rx=0 tx=0).stop 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 shutdown_connections 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd1ec0678f0 0x7fd1ec069db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2000087e0 0x7fd200168760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd200008380 0x7fd2000c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 --2- 172.21.15.40:0/1800804390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd200007fa0 0x7fd2000c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 >> 172.21.15.40:0/1800804390 conn(0x7fd20003cab0 msgr2=0x7fd200004e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 shutdown_connections 2024-05-12T22:52:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.287+0000 7fd20cca1640 1 -- 172.21.15.40:0/1800804390 wait complete. 2024-05-12T22:52:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 msgr2=0x7f2f4c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 0x7f2f4c069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f60039ed0 tx=0x7f2f68075240 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 msgr2=0x7f2f600bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00b7b0 tx=0x7f2f5c00d4c0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 shutdown_connections 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2f600c8590 0x7f2f600bd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f60037030 0x7f2f600bcf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2f4c067990 0x7f2f4c069e50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 --2- 172.21.15.40:0/3012673090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f60036c50 0x7f2f600bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 >> 172.21.15.40:0/3012673090 conn(0x7f2f6003a890 msgr2=0x7f2f600c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 shutdown_connections 2024-05-12T22:52:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.291+0000 7f2f527fc640 1 -- 172.21.15.40:0/3012673090 wait complete. 2024-05-12T22:52:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.295+0000 7f9d9ef7b640 1 -- 172.21.15.40:0/2590838582 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9d98156150 con 0x7f9d9814f090 2024-05-12T22:52:45.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-05-12T22:52:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.295+0000 7f9d957fa640 1 -- 172.21.15.40:0/2590838582 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d90010040 con 0x7f9d9814f090 2024-05-12T22:52:45.297 INFO:teuthology.orchestra.run.smithi040.stdout:60129542150 2024-05-12T22:52:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 msgr2=0x7f9d7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 0x7f9d7c069db0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0011f0 tx=0x7f9d8c007d40 comp rx=0 tx=0).stop 2024-05-12T22:52:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 msgr2=0x7f9d9813d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000efc0 tx=0x7f9d9000c490 comp rx=0 tx=0).stop 2024-05-12T22:52:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 shutdown_connections 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d9814f090 0x7f9d9813d1d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9814be00 0x7f9d9814b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9d7c0678f0 0x7f9d7c069db0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 --2- 172.21.15.40:0/2590838582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d980aecd0 0x7f9d9814b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 >> 172.21.15.40:0/2590838582 conn(0x7f9d980b6d50 msgr2=0x7f9d98072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 shutdown_connections 2024-05-12T22:52:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.299+0000 7f9d82ffd640 1 -- 172.21.15.40:0/2590838582 wait complete. 2024-05-12T22:52:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.303+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc1200f0bc0 con 0x7fc1200f5780 2024-05-12T22:52:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc124ff9640 1 -- 172.21.15.40:0/358418467 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1200f0bc0 con 0x7fc1200f5780 2024-05-12T22:52:45.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-05-12T22:52:45.306 INFO:teuthology.orchestra.run.smithi040.stdout:60129542150 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 msgr2=0x7fc10c069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 0x7fc10c069e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0aa000 tx=0x7fc11c001350 comp rx=0 tx=0).stop 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 msgr2=0x7fc1200f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc11400d800 tx=0x7fc11400dcc0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 shutdown_connections 2024-05-12T22:52:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc10c0679c0 0x7fc10c069e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1200f0ee0 0x7fc1200dad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1200f5780 0x7fc1200f4900 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 --2- 172.21.15.40:0/358418467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc118003b50 0x7fc1200f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.307+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 >> 172.21.15.40:0/358418467 conn(0x7fc12003a890 msgr2=0x7fc120035120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.311+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 shutdown_connections 2024-05-12T22:52:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.311+0000 7fc12d6c4640 1 -- 172.21.15.40:0/358418467 wait complete. 2024-05-12T22:52:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.315+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5908147bc0 con 0x7f59080b7c90 2024-05-12T22:52:45.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.315+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdccc1446e0 con 0x7fdccc06d640 2024-05-12T22:52:45.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.315+0000 7f5904ff9640 1 -- 172.21.15.40:0/1348506937 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58fc056600 con 0x7f59080b7c90 2024-05-12T22:52:45.315 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-05-12T22:52:45.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2024-05-12T22:52:45.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.315+0000 7fdcc2ffd640 1 -- 172.21.15.40:0/295440948 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdcbc059d10 con 0x7fdccc06d640 2024-05-12T22:52:45.317 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:45.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 msgr2=0x7f58f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 0x7f58f4069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f8008040 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 msgr2=0x7f5908143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b410 tx=0x7f58fc00b8d0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 shutdown_connections 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5908144130 0x7f5908142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59080b7c90 0x7f5908143bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 --2- 172.21.15.40:0/1348506937 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f59080b5b10 0x7f59081451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 >> 172.21.15.40:0/1348506937 conn(0x7f590806b490 msgr2=0x7f590806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 shutdown_connections 2024-05-12T22:52:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7f590d39b640 1 -- 172.21.15.40:0/1348506937 wait complete. 2024-05-12T22:52:45.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 msgr2=0x7fdcac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 0x7fdcac069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40b1000 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2024-05-12T22:52:45.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 msgr2=0x7fdccc13f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:45.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00c500 tx=0x7fdcbc00c9c0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 shutdown_connections 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdcac0678c0 0x7fdcac069d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc144d10 0x7fdccc14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdccc144000 0x7fdccc146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 --2- 172.21.15.40:0/295440948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdccc06d640 0x7fdccc13f8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 >> 172.21.15.40:0/295440948 conn(0x7fdccc0ba690 msgr2=0x7fdccc142530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 shutdown_connections 2024-05-12T22:52:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:45.319+0000 7fdcd0ef1640 1 -- 172.21.15.40:0/295440948 wait complete. 2024-05-12T22:52:45.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-05-12T22:52:45.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2024-05-12T22:52:45.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-05-12T22:52:45.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2024-05-12T22:52:46.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-12T22:52:46.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-12T22:52:46.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-12T22:52:46.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-12T22:52:46.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-12T22:52:46.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-12T22:52:46.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-12T22:52:46.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-12T22:52:46.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 Processor -- start 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 -- start start 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ea40b0410 0x7f4ea40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4ea4146c30 0x7f4ea41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea40737a0 con 0x7f4ea40b07f0 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea41475e0 con 0x7f4ea40b0410 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea8f00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea406f4f0 con 0x7f4ea4146c30 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ea40b0410 0x7f4ea40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ea40b0410 0x7f4ea40b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60220/0 (socket says 172.21.15.40:60220) 2024-05-12T22:52:46.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 -- 172.21.15.40:0/1388726221 learned_addr learned my addr 172.21.15.40:0/1388726221 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea2d9d640 1 --2- 172.21.15.40:0/1388726221 >> v2:172.21.15.47:3300/0 conn(0x7f4ea4146c30 0x7f4ea41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 -- 172.21.15.40:0/1388726221 >> v2:172.21.15.47:3300/0 conn(0x7f4ea4146c30 msgr2=0x7f4ea41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 --2- 172.21.15.40:0/1388726221 >> v2:172.21.15.47:3300/0 conn(0x7f4ea4146c30 0x7f4ea41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 -- 172.21.15.40:0/1388726221 >> v1:172.21.15.47:6789/0 conn(0x7f4ea40b07f0 legacy=0x7f4ea4073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.487+0000 7f4ea259c640 1 -- 172.21.15.40:0/1388726221 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea40b1c90 con 0x7f4ea40b0410 2024-05-12T22:52:46.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.491+0000 7f4ea259c640 1 --2- 172.21.15.40:0/1388726221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b0410 0x7f4ea40b1670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b24e0 tx=0x7f4e9801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4879df835260d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.491+0000 7f4ea159a640 1 -- 172.21.15.40:0/1388726221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b0070 con 0x7f4ea40b0410 2024-05-12T22:52:46.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.491+0000 7f4ea159a640 1 -- 172.21.15.40:0/1388726221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980ab600 con 0x7f4ea40b0410 2024-05-12T22:52:46.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.491+0000 7f4ea8f00640 1 -- 172.21.15.40:0/1388726221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b0410 msgr2=0x7f4ea40b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.491+0000 7f4ea8f00640 1 --2- 172.21.15.40:0/1388726221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b0410 0x7f4ea40b1670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b24e0 tx=0x7f4e9801c400 comp rx=0 tx=0).stop 2024-05-12T22:52:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 -- 172.21.15.40:0/1388726221 shutdown_connections 2024-05-12T22:52:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 --2- 172.21.15.40:0/1388726221 >> v2:172.21.15.47:3300/0 conn(0x7f4ea4146c30 0x7f4ea41470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 --2- 172.21.15.40:0/1388726221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b0410 0x7f4ea40b1670 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 -- 172.21.15.40:0/1388726221 >> 172.21.15.40:0/1388726221 conn(0x7f4ea406bc70 msgr2=0x7f4ea40b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 -- 172.21.15.40:0/1388726221 shutdown_connections 2024-05-12T22:52:46.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.503+0000 7f4ea8f00640 1 -- 172.21.15.40:0/1388726221 wait complete. 2024-05-12T22:52:46.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 Processor -- start 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 -- start start 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 0x7f4ea4072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ea4146c30 0x7f4ea41423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4150660 con 0x7f4ea40b07f0 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41504e0 con 0x7f4ea40b0410 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea8f00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea41507e0 con 0x7f4ea4146c30 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60234/0 (socket says 172.21.15.40:60234) 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea1d9b640 1 -- 172.21.15.40:0/173777405 learned_addr learned my addr 172.21.15.40:0/173777405 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 0x7f4ea4072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea2d9d640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ea4146c30 0x7f4ea41423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 -- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ea4146c30 msgr2=0x7f4ea41423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ea4146c30 0x7f4ea41423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 -- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 msgr2=0x7f4ea41f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 -- 172.21.15.40:0/173777405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea4143a40 con 0x7f4ea40b0410 2024-05-12T22:52:46.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea1d9b640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:46.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.507+0000 7f4ea259c640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 0x7f4ea4072100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b4d10 tx=0x7f4e980191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.511+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b0050 con 0x7f4ea40b0410 2024-05-12T22:52:46.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.511+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980ba070 con 0x7f4ea40b0410 2024-05-12T22:52:46.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.511+0000 7f4ea8f00640 1 -- 172.21.15.40:0/173777405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea4143d20 con 0x7f4ea40b0410 2024-05-12T22:52:46.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.511+0000 7f4ea8f00640 1 -- 172.21.15.40:0/173777405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea40b15b0 con 0x7f4ea40b0410 2024-05-12T22:52:46.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.511+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980aabb0 con 0x7f4ea40b0410 2024-05-12T22:52:46.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4ea8f00640 1 -- 172.21.15.40:0/173777405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e880052a0 con 0x7f4ea40b0410 2024-05-12T22:52:46.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e980ab600 con 0x7f4ea40b0410 2024-05-12T22:52:46.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4e92ffd640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 0x7f4e8c069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4e9811fc90 con 0x7f4ea40b0410 2024-05-12T22:52:46.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4ea1d9b640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 0x7f4e8c069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.515+0000 7f4ea1d9b640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 0x7f4e8c069f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ea41438a0 tx=0x7f4e94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.523+0000 7f3e144af640 1 Processor -- start 2024-05-12T22:52:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.523+0000 7f3e144af640 1 -- start start 2024-05-12T22:52:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 Processor -- start 2024-05-12T22:52:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 -- start start 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e144af640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e04006500 0x7f3e040356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e144af640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e040d9250 0x7f3e040db640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e144af640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040068e0 con 0x7f3e04035be0 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e144af640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3e04036d90 con 0x7f3e04006500 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e144af640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3e040d4e40 con 0x7f3e040d9250 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e04006500 0x7f3e040356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e04006500 0x7f3e040356a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60246/0 (socket says 172.21.15.40:60246) 2024-05-12T22:52:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 -- 172.21.15.40:0/1938423599 learned_addr learned my addr 172.21.15.40:0/1938423599 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 0x7f90940b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e12a4c640 1 --2- 172.21.15.40:0/1938423599 >> v2:172.21.15.47:3300/0 conn(0x7f3e040d9250 0x7f3e040db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940b8120 con 0x7f9094145820 2024-05-12T22:52:46.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940b6bb0 con 0x7f90940b7d40 2024-05-12T22:52:46.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9099abb640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f90940b7200 con 0x7f9094072fb0 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 -- 172.21.15.40:0/1938423599 >> v2:172.21.15.47:3300/0 conn(0x7f3e040d9250 msgr2=0x7f3e040db640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 --2- 172.21.15.40:0/1938423599 >> v2:172.21.15.47:3300/0 conn(0x7f3e040d9250 0x7f3e040db640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9093fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9094145820 0x7f9094156280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51712/0 (socket says 172.21.15.40:51712) 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9093fff640 1 -- 172.21.15.40:0/1586860690 learned_addr learned my addr 172.21.15.40:0/1586860690 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 -- 172.21.15.40:0/1938423599 >> v1:172.21.15.47:6789/0 conn(0x7f3e04035be0 legacy=0x7f3e040ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f3e1224b640 1 -- 172.21.15.40:0/1938423599 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040360b0 con 0x7f3e04006500 2024-05-12T22:52:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f04e6f3c640 1 Processor -- start 2024-05-12T22:52:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479331567 0 0) 0x7f90940b8120 con 0x7f9094145820 2024-05-12T22:52:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9080003530 con 0x7f9094145820 2024-05-12T22:52:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f04e6f3c640 1 -- start start 2024-05-12T22:52:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4e98016110 con 0x7f4ea40b0410 2024-05-12T22:52:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f908bfff640 1 --2- 172.21.15.40:0/1586860690 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 0x7f90940b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665290142 0 0) 0x7f90940b6bb0 con 0x7f90940b7d40 2024-05-12T22:52:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90940b8120 con 0x7f90940b7d40 2024-05-12T22:52:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f908bfff640 1 -- 172.21.15.40:0/1586860690 >> v1:172.21.15.47:6789/0 conn(0x7f90940b7d40 legacy=0x7f909406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f0ad7fff640 1 Processor -- start 2024-05-12T22:52:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520828400 0 0) 0x7f90940b8120 con 0x7f90940b7d40 2024-05-12T22:52:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f908bfff640 1 -- 172.21.15.40:0/1586860690 >> v1:172.21.15.40:6789/0 conn(0x7f9094145820 legacy=0x7f9094156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f908bfff640 1 -- 172.21.15.40:0/1586860690 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940b6e90 con 0x7f9094072fb0 2024-05-12T22:52:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f0ad7fff640 1 -- start start 2024-05-12T22:52:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f04e6f3c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04d8007f30 0x7f04d8009280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.527+0000 7f04e6f3c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80097c0 con 0x7f04d80d1100 2024-05-12T22:52:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e673b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f04d80d1560 0x7f04d80db290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47690/0 (socket says 172.21.15.40:47690) 2024-05-12T22:52:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e673b640 1 -- 172.21.15.40:0/655312839 learned_addr learned my addr 172.21.15.40:0/655312839 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d8008310 con 0x7f04d80d1560 2024-05-12T22:52:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f04d8007270 con 0x7f04d8007f30 2024-05-12T22:52:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 0x7f0ad814a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad7fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160082163 0 0) 0x7f04d8008310 con 0x7f04d80d1560 2024-05-12T22:52:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04cc003530 con 0x7f04d80d1560 2024-05-12T22:52:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad7fff640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80bd7a0 con 0x7f0ad8140f60 2024-05-12T22:52:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad7fff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80b68b0 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad7fff640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad80b40f0 con 0x7f0ad80b46b0 2024-05-12T22:52:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 Processor -- start 2024-05-12T22:52:46.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 -- start start 2024-05-12T22:52:46.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56494/0 (socket says 172.21.15.40:56494) 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 -- 172.21.15.40:0/3668604042 learned_addr learned my addr 172.21.15.40:0/3668604042 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad6ffd640 1 --2- 172.21.15.40:0/3668604042 >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 0x7f0ad814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 -- 172.21.15.40:0/3668604042 >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 msgr2=0x7f0ad814a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/655312839 >> v2:172.21.15.40:3300/0 conn(0x7f04d8007f30 0x7f04d8009280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1037630546 0 0) 0x7f04cc003530 con 0x7f04d80d1560 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 >> v2:172.21.15.40:3300/0 conn(0x7f04d8007f30 msgr2=0x7f04d8009280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 --2- 172.21.15.40:0/655312839 >> v2:172.21.15.40:3300/0 conn(0x7f04d8007f30 0x7f04d8009280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 >> v1:172.21.15.40:6789/0 conn(0x7f04d80d1100 legacy=0x7f04d8039560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 --2- 172.21.15.40:0/3668604042 >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 0x7f0ad814a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 -- 172.21.15.40:0/3668604042 >> v1:172.21.15.47:6789/0 conn(0x7f0ad8140f60 legacy=0x7f0ad81413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad67fc640 1 -- 172.21.15.40:0/3668604042 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80b43d0 con 0x7f0ad80b46b0 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8009a50 con 0x7f04d80d1560 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f04e004fe50 con 0x7f04d80d1560 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 >> v1:172.21.15.47:6789/0 conn(0x7f04d80d1560 legacy=0x7f04d80db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 0x7f04cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04cc004810 0x7f04cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04cc005220 0x7f04cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04d8007270 con 0x7f04cc0039c0 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc00c170 con 0x7f04cc005220 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc00c370 con 0x7f04cc004810 2024-05-12T22:52:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f0ad6ffd640 1 --2- 172.21.15.40:0/3668604042 >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 0x7f0ad814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f3e1224b640 1 --2- 172.21.15.40:0/1938423599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040356a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e04037690 tx=0x7f3dfc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25c4eaaaaf3b71c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e673b640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04cc005220 0x7f04cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f908bfff640 1 --2- 172.21.15.40:0/1586860690 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 0x7f90940b6570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f907c009770 tx=0x7f907c01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c6d96eccc16ebc server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500369a0 0x7fb850039860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8500d1510 0x7fb850035ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb850036d80 con 0x7fb850039da0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb850035090 con 0x7fb8500d1510 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e9f7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb8500352e0 con 0x7fb8500369a0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8500d1510 0x7fb850035ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8500d1510 0x7fb850035ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60258/0 (socket says 172.21.15.40:60258) 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 -- 172.21.15.40:0/4197290080 learned_addr learned my addr 172.21.15.40:0/4197290080 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85d9f5640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500369a0 0x7fb850039860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 0x7f04cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5739640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04cc004810 0x7f04cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0b0070 con 0x7f9094072fb0 2024-05-12T22:52:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 -- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04cc004810 msgr2=0x7f04cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04cc004810 0x7f04cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 -- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04cc005220 msgr2=0x7f04cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04cc005220 0x7f04cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e5f3a640 1 -- 172.21.15.40:0/655312839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc003530 con 0x7f04cc0039c0 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f04e673b640 1 -- 172.21.15.40:0/655312839 reap_dead start 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 -- 172.21.15.40:0/4197290080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500369a0 msgr2=0x7fb850039860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500369a0 0x7fb850039860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 -- 172.21.15.40:0/4197290080 >> v1:172.21.15.47:6789/0 conn(0x7fb850039da0 legacy=0x7fb8500d0e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-12T22:52:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7fb85e1f6640 1 -- 172.21.15.40:0/4197290080 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500355c0 con 0x7fb8500d1510 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f38c3362640 1 Processor -- start 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f38c3362640 1 -- start start 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.531+0000 7f9092ffd640 1 -- 172.21.15.40:0/1586860690 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c0ab400 con 0x7f9094072fb0 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 -- 172.21.15.40:0/1586860690 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 msgr2=0x7f90940b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 --2- 172.21.15.40:0/1586860690 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 0x7f90940b6570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f907c009770 tx=0x7f907c01c310 comp rx=0 tx=0).stop 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 -- 172.21.15.40:0/1586860690 shutdown_connections 2024-05-12T22:52:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 --2- 172.21.15.40:0/1586860690 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094072fb0 0x7f90940b6570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 -- 172.21.15.40:0/1586860690 >> 172.21.15.40:0/1586860690 conn(0x7f909406b490 msgr2=0x7f909406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad67fc640 1 --2- 172.21.15.40:0/3668604042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ba64858152b985 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c3362640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38b402b540 0x7f38b40c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c3362640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b4037ab0 con 0x7f38b40376d0 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c3362640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b402ba90 con 0x7f38b40ce3a0 2024-05-12T22:52:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c3362640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f38b402a6e0 con 0x7f38b402b540 2024-05-12T22:52:46.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad5ffb640 1 -- 172.21.15.40:0/3668604042 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80b0070 con 0x7f0ad80b46b0 2024-05-12T22:52:46.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c10fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f38b40376d0 0x7f38b40cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51720/0 (socket says 172.21.15.40:51720) 2024-05-12T22:52:46.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c10fe640 1 -- 172.21.15.40:0/3240239879 learned_addr learned my addr 172.21.15.40:0/3240239879 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:46.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e11249640 1 -- 172.21.15.40:0/1938423599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b0070 con 0x7f3e04006500 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e11249640 1 -- 172.21.15.40:0/1938423599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0a4e50 con 0x7f3e04006500 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad5ffb640 1 -- 172.21.15.40:0/3668604042 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac80ab600 con 0x7f0ad80b46b0 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551321831 0 0) 0x7f38b402ba90 con 0x7f38b40ce3a0 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a8003530 con 0x7f38b40ce3a0 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272430969 0 0) 0x7f38b4037ab0 con 0x7f38b40376d0 2024-05-12T22:52:46.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b402ba90 con 0x7f38b40376d0 2024-05-12T22:52:46.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 -- 172.21.15.40:0/1586860690 shutdown_connections 2024-05-12T22:52:46.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c08fd640 1 --2- 172.21.15.40:0/3240239879 >> v2:172.21.15.40:3300/0 conn(0x7f38b402b540 0x7f38b40c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 0x7f04cc003de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d000ba10 tx=0x7f04d001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a24b2ddd625b7d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c08fd640 1 -- 172.21.15.40:0/3240239879 >> v1:172.21.15.47:6789/0 conn(0x7f38b40ce3a0 legacy=0x7f38b40c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c08fd640 1 -- 172.21.15.40:0/3240239879 >> v1:172.21.15.40:6789/0 conn(0x7f38b40376d0 legacy=0x7f38b40cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f38c08fd640 1 -- 172.21.15.40:0/3240239879 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b402a9c0 con 0x7f38b402b540 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f9099abb640 1 -- 172.21.15.40:0/1586860690 wait complete. 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8500d1510 0x7fb850035ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb854009870 tx=0x7fb85401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e500eb122a91e63d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85c9f3640 1 -- 172.21.15.40:0/4197290080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8540b0070 con 0x7fb8500d1510 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85c9f3640 1 -- 172.21.15.40:0/4197290080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8540ab600 con 0x7fb8500d1510 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85c9f3640 1 -- 172.21.15.40:0/4197290080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8540ab9d0 con 0x7fb8500d1510 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 -- 172.21.15.40:0/4197290080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8500d1510 msgr2=0x7fb850035ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8500d1510 0x7fb850035ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb854009870 tx=0x7fb85401c400 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 -- 172.21.15.40:0/4197290080 shutdown_connections 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8500d1510 0x7fb850035ae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/4197290080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500369a0 0x7fb850039860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7fb85e9f7640 1 -- 172.21.15.40:0/4197290080 >> 172.21.15.40:0/4197290080 conn(0x7fb85003a890 msgr2=0x7fb85003aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 -- 172.21.15.40:0/3668604042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 msgr2=0x7f0ad814ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 --2- 172.21.15.40:0/3668604042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac801c460 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 -- 172.21.15.40:0/3668604042 shutdown_connections 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 --2- 172.21.15.40:0/3668604042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad80b46b0 0x7f0ad814ada0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 --2- 172.21.15.40:0/3668604042 >> v2:172.21.15.40:3300/0 conn(0x7f0ad80bd3c0 0x7f0ad814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 -- 172.21.15.40:0/3668604042 >> 172.21.15.40:0/3668604042 conn(0x7f0ad8072df0 msgr2=0x7f0ad8073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e11249640 1 -- 172.21.15.40:0/1938423599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0ab820 con 0x7f3e04006500 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 -- 172.21.15.40:0/1938423599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 msgr2=0x7f3e040356a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 --2- 172.21.15.40:0/1938423599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040356a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e04037690 tx=0x7f3dfc01c490 comp rx=0 tx=0).stop 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 -- 172.21.15.40:0/1938423599 shutdown_connections 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 --2- 172.21.15.40:0/1938423599 >> v2:172.21.15.47:3300/0 conn(0x7f3e040d9250 0x7f3e040db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 --2- 172.21.15.40:0/1938423599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040356a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 -- 172.21.15.40:0/1938423599 >> 172.21.15.40:0/1938423599 conn(0x7f3e0403b120 msgr2=0x7f3e0403b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b3070 con 0x7f04cc0039c0 2024-05-12T22:52:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00ae410 con 0x7f04cc0039c0 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e4f38640 1 -- 172.21.15.40:0/655312839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d000b5e0 con 0x7f04cc0039c0 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 msgr2=0x7f04cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e6f3c640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 0x7f04cc003de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d000ba10 tx=0x7f04d001c680 comp rx=0 tx=0).stop 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 -- 172.21.15.40:0/3668604042 shutdown_connections 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 shutdown_connections 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e6f3c640 1 --2- 172.21.15.40:0/655312839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04cc0039c0 0x7f04cc003de0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d000ba10 tx=0x7f04d001c680 comp rx=0 tx=0).stop 2024-05-12T22:52:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 >> 172.21.15.40:0/655312839 conn(0x7f04d803c6b0 msgr2=0x7f04d803cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f0ad7fff640 1 -- 172.21.15.40:0/3668604042 wait complete. 2024-05-12T22:52:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- 172.21.15.40:0/4197290080 shutdown_connections 2024-05-12T22:52:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- 172.21.15.40:0/4197290080 wait complete. 2024-05-12T22:52:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 shutdown_connections 2024-05-12T22:52:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.535+0000 7f3e144af640 1 -- 172.21.15.40:0/1938423599 shutdown_connections 2024-05-12T22:52:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 -- 172.21.15.40:0/1938423599 wait complete. 2024-05-12T22:52:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 Processor -- start 2024-05-12T22:52:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 -- start start 2024-05-12T22:52:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 Processor -- start 2024-05-12T22:52:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 Processor -- start 2024-05-12T22:52:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- 172.21.15.40:0/655312839 wait complete. 2024-05-12T22:52:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 Processor -- start 2024-05-12T22:52:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c08fd640 1 --2- 172.21.15.40:0/3240239879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40c3eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0097c0 tx=0x7f38ac01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb54c2be262ae5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9094072fb0 0x7f9094148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90940b7d40 0x7f90941463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f909415a750 con 0x7f9094072fb0 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f909415a5d0 con 0x7f90940b7d40 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9099abb640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f909415a8d0 con 0x7f9094145820 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 -- start start 2024-05-12T22:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 0x7f0ad8143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 Processor -- start 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 -- start start 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487c0b2c80 0x7f487c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 0x7f487c156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c0b54c0 con 0x7f487c06c740 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f487c0b3110 con 0x7f487c0b2c80 2024-05-12T22:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f48823d2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f487c14fdc0 con 0x7f487c14f970 2024-05-12T22:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 Processor -- start 2024-05-12T22:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- start start 2024-05-12T22:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f488096f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 0x7f487c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f488096f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 0x7f487c156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56524/0 (socket says 172.21.15.40:56524) 2024-05-12T22:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f488096f640 1 -- 172.21.15.40:0/2948362222 learned_addr learned my addr 172.21.15.40:0/2948362222 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56536/0 (socket says 172.21.15.40:56536) 2024-05-12T22:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 -- 172.21.15.40:0/1314266240 learned_addr learned my addr 172.21.15.40:0/1314266240 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f908bfff640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90940b7d40 0x7f90941463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- start start 2024-05-12T22:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 -- start start 2024-05-12T22:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f90937fe640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9094072fb0 0x7f9094148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2948362222 >> v2:172.21.15.40:3300/0 conn(0x7f487c0b2c80 0x7f487c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0b0070 con 0x7f38b402b540 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac0ab400 con 0x7f38b402b540 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 0x7fb8500ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb850039da0 0x7fb8500c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 0x7fb8500cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500ddde0 con 0x7fb850039da0 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500ddc60 con 0x7fb8500369a0 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e9f7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb8500ddf60 con 0x7fb8500d1510 2024-05-12T22:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 0x7f0ad8143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60286/0 (socket says 172.21.15.40:60286) 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 0x7f0ad8143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50718/0 (socket says 172.21.15.40:50718) 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad8140f60 0x7f0ad81ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04d80c8a10 0x7f04d8169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 0x7f04d80c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 0x7f04d816cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80d3f40 con 0x7f04d80c5bf0 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04d8039f80 con 0x7f04d816a1e0 2024-05-12T22:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e6f3c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f04d80d40c0 con 0x7f04d80c8a10 2024-05-12T22:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 -- 172.21.15.40:0/202179883 learned_addr learned my addr 172.21.15.40:0/202179883 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad81547a0 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 -- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90940b7d40 msgr2=0x7f90941463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90940b7d40 0x7f90941463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 -- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9094072fb0 msgr2=0x7f9094148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9094072fb0 0x7f9094148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f9093fff640 1 -- 172.21.15.40:0/1314266240 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9094148280 con 0x7f9094145820 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8154620 con 0x7f0ad80b46b0 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85d9f5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 0x7fb8500ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85d9f5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 0x7fb8500ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50720/0 (socket says 172.21.15.40:50720) 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85d9f5640 1 -- 172.21.15.40:0/2051232440 learned_addr learned my addr 172.21.15.40:0/2051232440 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 0x7fb8500cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad8154920 con 0x7f0ad8140f60 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad77fe640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad8140f60 0x7f0ad81ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 -- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad8140f60 msgr2=0x7f0ad81ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad8140f60 0x7f0ad81ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 -- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 msgr2=0x7f0ad8143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 0x7f0ad8143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f0ad67fc640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8072120 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04035be0 0x7f3e0416c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e040d9250 0x7f3e040c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040386e0 con 0x7f3e04006500 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04038560 con 0x7f3e04035be0 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e144af640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f3e04036590 con 0x7f3e040d9250 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e1224b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e1224b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60304/0 (socket says 172.21.15.40:60304) 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e1224b640 1 -- 172.21.15.40:0/2524330094 learned_addr learned my addr 172.21.15.40:0/2524330094 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e11a4a640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04035be0 0x7f3e0416c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e5739640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 0x7f04d80c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e5739640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 0x7f04d80c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:50726/0 (socket says 172.21.15.40:50726) 2024-05-12T22:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e5739640 1 -- 172.21.15.40:0/60704538 learned_addr learned my addr 172.21.15.40:0/60704538 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04d80c8a10 0x7f04d8169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f487b7fe640 1 -- 172.21.15.40:0/2948362222 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 msgr2=0x7f487c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2948362222 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 0x7f487c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f487b7fe640 1 -- 172.21.15.40:0/2948362222 >> v1:172.21.15.40:6789/0 conn(0x7f487c06c740 legacy=0x7f487c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f487b7fe640 1 -- 172.21.15.40:0/2948362222 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c06cb20 con 0x7f487c0b2c80 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38b3fff640 1 -- 172.21.15.40:0/3240239879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0ab7d0 con 0x7f38b402b540 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c3362640 1 -- 172.21.15.40:0/3240239879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 msgr2=0x7f38b40c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c3362640 1 --2- 172.21.15.40:0/3240239879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40c3eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0097c0 tx=0x7f38ac01c380 comp rx=0 tx=0).stop 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c3362640 1 -- 172.21.15.40:0/3240239879 shutdown_connections 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c3362640 1 --2- 172.21.15.40:0/3240239879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40c3eb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f38c3362640 1 -- 172.21.15.40:0/3240239879 >> 172.21.15.40:0/3240239879 conn(0x7f38b403ace0 msgr2=0x7f38b403b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85d1f4640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb850039da0 0x7fb8500c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.539+0000 7f3e12a4c640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e040d9250 0x7f3e040c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0ad67fc640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80ae040 tx=0x7f0ac8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 0x7f04d816cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 -- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e040d9250 msgr2=0x7f3e040c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e040d9250 0x7f3e040c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 -- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04035be0 msgr2=0x7f3e0416c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04035be0 0x7f3e0416c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 -- 172.21.15.40:0/2524330094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040cebb0 con 0x7f3e04006500 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9093fff640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f908c00ca50 tx=0x7f908c00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 -- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 msgr2=0x7fb8500ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 0x7fb8500ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 -- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb850039da0 msgr2=0x7fb8500c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb850039da0 0x7fb8500c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 -- 172.21.15.40:0/2051232440 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500c9090 con 0x7fb8500d1510 2024-05-12T22:52:46.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- 172.21.15.40:0/3240239879 shutdown_connections 2024-05-12T22:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80b8020 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac80aa860 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80b0040 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 -- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04d80c8a10 msgr2=0x7f04d8169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04d80c8a10 0x7f04d8169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 -- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 msgr2=0x7f04d80c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 0x7f04d80c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 -- 172.21.15.40:0/60704538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d81697e0 con 0x7f04d80c5bf0 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e673b640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 0x7f04d816cd10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04e002d760 tx=0x7f04e00695c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e1f6640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 0x7fb8500cc1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8500071d0 tx=0x7fb8540191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- 172.21.15.40:0/3240239879 wait complete. 2024-05-12T22:52:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad8072390 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad80711b0 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8540ba070 con 0x7fb8500d1510 2024-05-12T22:52:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8500c9e10 con 0x7fb8500d1510 2024-05-12T22:52:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8500d4270 con 0x7fb8500d1510 2024-05-12T22:52:46.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 Processor -- start 2024-05-12T22:52:46.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8540b1040 con 0x7fb8500d1510 2024-05-12T22:52:46.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c017070 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c00abb0 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c012400 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909413b2c0 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f909413e2b0 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9094068a40 con 0x7f9094145820 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f3e1224b640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc01a0c0 tx=0x7f3dfc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2948362222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0b2c80 0x7f487c14f430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4874009dc0 tx=0x7f487401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c90fd177387bd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- start start 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38b40ce3a0 0x7f38b40c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d6670 con 0x7f38b402b540 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d64f0 con 0x7f38b40ce3a0 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c3362640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40d67f0 con 0x7f38b40376d0 2024-05-12T22:52:46.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8540b0050 con 0x7fb8500d1510 2024-05-12T22:52:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8400052a0 con 0x7fb8500d1510 2024-05-12T22:52:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c08fd640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c08fd640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56580/0 (socket says 172.21.15.40:56580) 2024-05-12T22:52:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f38c08fd640 1 -- 172.21.15.40:0/1061639951 learned_addr learned my addr 172.21.15.40:0/1061639951 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0091070 con 0x7f04d80c5bf0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0073950 con 0x7f04d80c5bf0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0071a90 con 0x7f04d80c5bf0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e6f3c640 1 -- 172.21.15.40:0/60704538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d816a660 con 0x7f04d80c5bf0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f04e6f3c640 1 -- 172.21.15.40:0/60704538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d80c8df0 con 0x7f04d80c5bf0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad80b62f0 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ac80bb020 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 0x7f0ac4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.543+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ac811f690 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f0ad6ffd640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 0x7f0ac4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c18ff640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38b40ce3a0 0x7f38b40c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c10fe640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f487affd640 1 -- 172.21.15.40:0/2948362222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740b2070 con 0x7f487c0b2c80 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 -- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38b40ce3a0 msgr2=0x7f38b40c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38b40ce3a0 0x7f38b40c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 -- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 msgr2=0x7f38b40bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 -- 172.21.15.40:0/1061639951 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40d59b0 con 0x7f38b40376d0 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b9020 con 0x7f3e04006500 2024-05-12T22:52:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e040da3b0 con 0x7f3e04006500 2024-05-12T22:52:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f04e6f3c640 1 -- 172.21.15.40:0/60704538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8005720 con 0x7f04d80c5bf0 2024-05-12T22:52:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e040cee20 con 0x7f3e04006500 2024-05-12T22:52:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f38c08fd640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f38ac019fb0 tx=0x7f38ac019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8540bd070 con 0x7fb8500d1510 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7fb84e7fc640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 0x7fb83c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb85411f7a0 con 0x7fb8500d1510 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7fb85d9f5640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 0x7fb83c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7fb85d9f5640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 0x7fb83c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb85806a8f0 tx=0x7fb85808d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e040ce550 con 0x7f3e04006500 2024-05-12T22:52:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f908c01a070 con 0x7f9094145820 2024-05-12T22:52:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f9090ff9640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 0x7f9074069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f90937fe640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 0x7f9074069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f908c085d90 con 0x7f9094145820 2024-05-12T22:52:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.547+0000 7f90937fe640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 0x7f9074069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f909406d810 tx=0x7f9084009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f0ad6ffd640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 0x7f0ac4069e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009580 tx=0x7f0acc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0ac80c2030 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc000e50 con 0x7f3e04006500 2024-05-12T22:52:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b0050 con 0x7f3e04006500 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f487affd640 1 -- 172.21.15.40:0/2948362222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48740a5870 con 0x7f487c0b2c80 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f487affd640 1 -- 172.21.15.40:0/2948362222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740a5c40 con 0x7f487c0b2c80 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 -- 172.21.15.40:0/2948362222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0b2c80 msgr2=0x7f487c14f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 --2- 172.21.15.40:0/2948362222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0b2c80 0x7f487c14f430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4874009dc0 tx=0x7f487401c8e0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 -- 172.21.15.40:0/2948362222 shutdown_connections 2024-05-12T22:52:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 --2- 172.21.15.40:0/2948362222 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c14f970 0x7f487c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 --2- 172.21.15.40:0/2948362222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0b2c80 0x7f487c14f430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 -- 172.21.15.40:0/2948362222 >> 172.21.15.40:0/2948362222 conn(0x7f487c0b8de0 msgr2=0x7f487c0b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 -- 172.21.15.40:0/2948362222 shutdown_connections 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f48823d2640 1 -- 172.21.15.40:0/2948362222 wait complete. 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.551+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04e006c070 con 0x7f04d80c5bf0 2024-05-12T22:52:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f04d67fc640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04e0101aa0 con 0x7f04d80c5bf0 2024-05-12T22:52:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 Processor -- start 2024-05-12T22:52:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f04e5f3a640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 0x7f04c4069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04d00b0000 tx=0x7f04d00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 -- start start 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c06c740 0x7f487c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f487c0b2c80 0x7f487c139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f487c0b1360 con 0x7f487c14f970 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f487c0b1080 con 0x7f487c0b2c80 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f48823d2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f487c0b27f0 con 0x7f487c06c740 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60338/0 (socket says 172.21.15.40:60338) 2024-05-12T22:52:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 -- 172.21.15.40:0/790046888 learned_addr learned my addr 172.21.15.40:0/790046888 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3dfc0bc020 con 0x7f3e04006500 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f487bfff640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c06c740 0x7f487c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f487b7fe640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f487c0b2c80 0x7f487c139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 -- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c06c740 msgr2=0x7f487c071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c06c740 0x7f487c071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 -- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f487c0b2c80 msgr2=0x7f487c139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f487c0b2c80 0x7f487c139b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 -- 172.21.15.40:0/790046888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0705c0 con 0x7f487c14f970 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f488096f640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f486c00e820 tx=0x7f486c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f3e02ffd640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f3e11a4a640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3dfc1200f0 con 0x7f3e04006500 2024-05-12T22:52:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.555+0000 7f3e11a4a640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 0x7f3df0069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e040c1d20 tx=0x7f3e08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.559+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f04d816a660 con 0x7f04d80c5bf0 2024-05-12T22:52:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.559+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f908c021020 con 0x7f9094145820 2024-05-12T22:52:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3dfc0c3070 con 0x7f3e04006500 2024-05-12T22:52:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c017070 con 0x7f487c14f970 2024-05-12T22:52:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c13b870 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c0708a0 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486c00c940 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c00cd50 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f486c01a070 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.563+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c068330 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.567+0000 7f4878ff9640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 0x7f4864069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.567+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f486c085e20 con 0x7f487c14f970 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.567+0000 7f487bfff640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 0x7f4864069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.567+0000 7f487bfff640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 0x7f4864069ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f487c14d690 tx=0x7f4870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f486c056300 con 0x7f487c14f970 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0b9020 con 0x7f38b40376d0 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac0abe50 con 0x7f38b40376d0 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b40cf340 con 0x7f38b40376d0 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b40c3d70 con 0x7f38b40376d0 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0b0040 con 0x7f38b40376d0 2024-05-12T22:52:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.571+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb8540c4020 con 0x7fb8500d1510 2024-05-12T22:52:46.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.575+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38ac0bc020 con 0x7f38b40376d0 2024-05-12T22:52:46.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.575+0000 7f38b1ffb640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 0x7f38a0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:46.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.575+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38ac11f850 con 0x7f38b40376d0 2024-05-12T22:52:46.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.575+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c0052a0 con 0x7f38b40376d0 2024-05-12T22:52:46.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.575+0000 7f38c10fe640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 0x7f38a0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:46.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.579+0000 7f38c10fe640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 0x7f38a0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38b80011f0 tx=0x7f38b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:46.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.591+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f38ac016090 con 0x7f38b40376d0 2024-05-12T22:52:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.859+0000 7f4ea8f00640 1 -- 172.21.15.40:0/173777405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4e88005860 con 0x7f4ea40b0410 2024-05-12T22:52:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.859+0000 7f4e92ffd640 1 -- 172.21.15.40:0/173777405 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e980f01f0 con 0x7f4ea40b0410 2024-05-12T22:52:46.861 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 msgr2=0x7f4e8c069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 0x7f4e8c069f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ea41438a0 tx=0x7f4e94009040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 msgr2=0x7f4ea4072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 0x7f4ea4072100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b4d10 tx=0x7f4e980191a0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 shutdown_connections 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4ea4146c30 0x7f4ea41423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b07f0 0x7f4ea41f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4e8c067a60 0x7f4e8c069f20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 --2- 172.21.15.40:0/173777405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40b0410 0x7f4ea4072100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 >> 172.21.15.40:0/173777405 conn(0x7f4ea406bc70 msgr2=0x7f4ea40b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 shutdown_connections 2024-05-12T22:52:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f4e90ff9640 1 -- 172.21.15.40:0/173777405 wait complete. 2024-05-12T22:52:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f04e6f3c640 1 -- 172.21.15.40:0/60704538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f04d8008310 con 0x7f04d80c5bf0 2024-05-12T22:52:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.863+0000 7f04d67fc640 1 -- 172.21.15.40:0/60704538 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04d81697e0 con 0x7f04d80c5bf0 2024-05-12T22:52:46.867 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 msgr2=0x7f04c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 0x7f04c4069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04d00b0000 tx=0x7f04d00046d0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 msgr2=0x7f04d816cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 0x7f04d816cd10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04e002d760 tx=0x7f04e00695c0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 shutdown_connections 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d80c5bf0 0x7f04d816cd10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.867+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.871+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04d816a1e0 0x7f04d80c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.871+0000 7f04c3fff640 1 --2- 172.21.15.40:0/60704538 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04d80c8a10 0x7f04d8169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.871+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 >> 172.21.15.40:0/60704538 conn(0x7f04d803c6b0 msgr2=0x7f04d803dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.871+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 shutdown_connections 2024-05-12T22:52:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.871+0000 7f04c3fff640 1 -- 172.21.15.40:0/60704538 wait complete. 2024-05-12T22:52:46.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.883+0000 7f0ad7fff640 1 -- 172.21.15.40:0/202179883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0ad80696b0 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.883+0000 7f0abf7fe640 1 -- 172.21.15.40:0/202179883 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ac8016170 con 0x7f0ad80bd3c0 2024-05-12T22:52:46.883 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-05-12T22:52:46.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-05-12T22:52:46.889 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 msgr2=0x7f0ac4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 0x7f0ac4069e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009580 tx=0x7f0acc009190 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 msgr2=0x7f0ad806fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80ae040 tx=0x7f0ac8019200 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 shutdown_connections 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ad8140f60 0x7f0ad81ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ad80bd3c0 0x7f0ad806fa40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f0ac4067990 0x7f0ac4069e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 --2- 172.21.15.40:0/202179883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80b46b0 0x7f0ad8143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 >> 172.21.15.40:0/202179883 conn(0x7f0ad8072df0 msgr2=0x7f0ad81472e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 shutdown_connections 2024-05-12T22:52:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.887+0000 7f0abd7fa640 1 -- 172.21.15.40:0/202179883 wait complete. 2024-05-12T22:52:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.891+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9094144e60 con 0x7f9094145820 2024-05-12T22:52:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.891+0000 7f9090ff9640 1 -- 172.21.15.40:0/1314266240 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9094148280 con 0x7f9094145820 2024-05-12T22:52:46.892 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:46.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f487c1493b0 con 0x7f487c14f970 2024-05-12T22:52:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f4878ff9640 1 -- 172.21.15.40:0/790046888 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f486c05a600 con 0x7f487c14f970 2024-05-12T22:52:46.896 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-05-12T22:52:46.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-05-12T22:52:46.897 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 msgr2=0x7f9074069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 0x7f9074069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f909406d810 tx=0x7f9084009040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 msgr2=0x7f9094146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f908c00ca50 tx=0x7f908c00cf10 comp rx=0 tx=0).stop 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 shutdown_connections 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9094145820 0x7f9094146900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9074067910 0x7f9074069dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90940b7d40 0x7f90941463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 --2- 172.21.15.40:0/1314266240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9094072fb0 0x7f9094148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 >> 172.21.15.40:0/1314266240 conn(0x7f909406b490 msgr2=0x7f90940bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 shutdown_connections 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.895+0000 7f9099abb640 1 -- 172.21.15.40:0/1314266240 wait complete. 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3e04005700 con 0x7f3e04006500 2024-05-12T22:52:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 msgr2=0x7f4864069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 0x7f4864069ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f487c14d690 tx=0x7f4870009040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 msgr2=0x7f487c13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f486c00e820 tx=0x7f486c00ece0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e02ffd640 1 -- 172.21.15.40:0/2524330094 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3dfc016110 con 0x7f3e04006500 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 shutdown_connections 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c14f970 0x7f487c13a0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f4864067a00 0x7f4864069ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f487c0b2c80 0x7f487c139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 --2- 172.21.15.40:0/790046888 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f487c06c740 0x7f487c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 >> 172.21.15.40:0/790046888 conn(0x7f487c0b8de0 msgr2=0x7f487c14b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 shutdown_connections 2024-05-12T22:52:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 msgr2=0x7f3df0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 0x7f3df0069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e040c1d20 tx=0x7f3e08009040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f48823d2640 1 -- 172.21.15.40:0/790046888 wait complete. 2024-05-12T22:52:46.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 msgr2=0x7f3e040dabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc01a0c0 tx=0x7f3dfc019230 comp rx=0 tx=0).stop 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 shutdown_connections 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e040d9250 0x7f3e040c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f3df00678c0 0x7f3df0069d80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04035be0 0x7f3e0416c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 --2- 172.21.15.40:0/2524330094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e04006500 0x7f3e040dabb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 >> 172.21.15.40:0/2524330094 conn(0x7f3e0403b120 msgr2=0x7f3e040d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 shutdown_connections 2024-05-12T22:52:46.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7f3e144af640 1 -- 172.21.15.40:0/2524330094 wait complete. 2024-05-12T22:52:46.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.899+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb840005860 con 0x7fb8500d1510 2024-05-12T22:52:46.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.903+0000 7fb84e7fc640 1 -- 172.21.15.40:0/2051232440 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb854016110 con 0x7fb8500d1510 2024-05-12T22:52:46.904 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-05-12T22:52:46.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.903+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 msgr2=0x7fb83c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.903+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 0x7fb83c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb85806a8f0 tx=0x7fb85808d040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.903+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 msgr2=0x7fb8500cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.903+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 0x7fb8500cc1f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8500071d0 tx=0x7fb8540191a0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 shutdown_connections 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500d1510 0x7fb8500cc1f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb850039da0 0x7fb8500c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb83c067990 0x7fb83c069e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 --2- 172.21.15.40:0/2051232440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500369a0 0x7fb8500ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 >> 172.21.15.40:0/2051232440 conn(0x7fb85003a890 msgr2=0x7fb8500d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 shutdown_connections 2024-05-12T22:52:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.907+0000 7fb85e9f7640 1 -- 172.21.15.40:0/2051232440 wait complete. 2024-05-12T22:52:46.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-05-12T22:52:46.918 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.919+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f389c005590 con 0x7f38b40376d0 2024-05-12T22:52:46.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.919+0000 7f38b1ffb640 1 -- 172.21.15.40:0/1061639951 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38ac0f0400 con 0x7f38b40376d0 2024-05-12T22:52:46.920 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-05-12T22:52:46.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 msgr2=0x7f38a0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 0x7f38a0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38b80011f0 tx=0x7f38b8009040 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 msgr2=0x7f38b40c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f38ac019fb0 tx=0x7f38ac019120 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 shutdown_connections 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f38a0067990 0x7f38a0069e50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38b40ce3a0 0x7f38b40c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f38b40376d0 0x7f38b40c36d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 --2- 172.21.15.40:0/1061639951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b402b540 0x7f38b40bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 >> 172.21.15.40:0/1061639951 conn(0x7f38b403ace0 msgr2=0x7f38b403ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 shutdown_connections 2024-05-12T22:52:46.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:46.923+0000 7f38c3362640 1 -- 172.21.15.40:0/1061639951 wait complete. 2024-05-12T22:52:46.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-05-12T22:52:46.928 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2024-05-12T22:52:46.932 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-05-12T22:52:46.933 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-05-12T22:52:46.934 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-05-12T22:52:46.941 DEBUG:teuthology.parallel:result is None 2024-05-12T22:52:46.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T22:52:46.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:47.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 Processor -- start 2024-05-12T22:52:47.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 -- start start 2024-05-12T22:52:47.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c149070 0x7fdf8c13f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf8c0b2c50 0x7fdf8c13f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8c0b6150 con 0x7fdf8c0b5d70 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdf8c06f990 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf926b8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8c0708b0 con 0x7fdf8c149070 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf8c0b2c50 0x7fdf8c13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf8c0b2c50 0x7fdf8c13f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60352/0 (socket says 172.21.15.40:60352) 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 -- 172.21.15.40:0/1171982276 learned_addr learned my addr 172.21.15.40:0/1171982276 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf83fff640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c149070 0x7fdf8c13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 -- 172.21.15.40:0/1171982276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c149070 msgr2=0x7fdf8c13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c149070 0x7fdf8c13f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 -- 172.21.15.40:0/1171982276 >> v1:172.21.15.47:6789/0 conn(0x7fdf8c0b5d70 legacy=0x7fdf8c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 -- 172.21.15.40:0/1171982276 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c06f620 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf90c55640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c0b2c50 0x7fdf8c13f590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009e80 tx=0x7fdf8401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fced75e8a014756 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.091+0000 7fdf8b7fe640 1 -- 172.21.15.40:0/1171982276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a5860 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf8b7fe640 1 -- 172.21.15.40:0/1171982276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840a5a00 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf8b7fe640 1 -- 172.21.15.40:0/1171982276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a5dd0 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1171982276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c0b2c50 msgr2=0x7fdf8c13f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c0b2c50 0x7fdf8c13f590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009e80 tx=0x7fdf8401c980 comp rx=0 tx=0).stop 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1171982276 shutdown_connections 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c0b2c50 0x7fdf8c13f590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1171982276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c149070 0x7fdf8c13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1171982276 >> 172.21.15.40:0/1171982276 conn(0x7fdf8c06b6c0 msgr2=0x7fdf8c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1171982276 shutdown_connections 2024-05-12T22:52:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1171982276 wait complete. 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 Processor -- start 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- start start 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c0b2c50 0x7fdf8c144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 0x7fdf8c1e3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1506e0 con 0x7fdf8c149070 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c150560 con 0x7fdf8c0b5d70 2024-05-12T22:52:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8c150860 con 0x7fdf8c0b2c50 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60360/0 (socket says 172.21.15.40:60360) 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 -- 172.21.15.40:0/1519978486 learned_addr learned my addr 172.21.15.40:0/1519978486 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf83fff640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 0x7fdf8c1e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf8bfff640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c0b2c50 0x7fdf8c144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 -- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c0b2c50 msgr2=0x7fdf8c144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c0b2c50 0x7fdf8c144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 -- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 msgr2=0x7fdf8c1e3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 0x7fdf8c1e3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 -- 172.21.15.40:0/1519978486 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c145390 con 0x7fdf8c149070 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf83fff640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 0x7fdf8c1e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf90c55640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf8401b030 tx=0x7fdf84019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840bc020 con 0x7fdf8c149070 2024-05-12T22:52:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840b8880 con 0x7fdf8c149070 2024-05-12T22:52:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c0b86a0 con 0x7fdf8c149070 2024-05-12T22:52:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84009270 con 0x7fdf8c149070 2024-05-12T22:52:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c145610 con 0x7fdf8c149070 2024-05-12T22:52:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.095+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf8c068330 con 0x7fdf8c149070 2024-05-12T22:52:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.099+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf840bf020 con 0x7fdf8c149070 2024-05-12T22:52:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.099+0000 7fdf897fa640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.099+0000 7fdf8bfff640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.099+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf841205b0 con 0x7fdf8c149070 2024-05-12T22:52:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.099+0000 7fdf8bfff640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 0x7fdf6c069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.103+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdf840c7020 con 0x7fdf8c149070 2024-05-12T22:52:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.255+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf8c1458f0 con 0x7fdf6c0678f0 2024-05-12T22:52:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.263+0000 7fdf897fa640 1 -- 172.21.15.40:0/1519978486 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251913 (secure 0 0 0) 0x7fdf8c1458f0 con 0x7fdf6c0678f0 2024-05-12T22:52:47.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:47.268 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:47.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 msgr2=0x7fdf6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 0x7fdf6c069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c009040 comp rx=0 tx=0).stop 2024-05-12T22:52:47.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 msgr2=0x7fdf8c1e3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf8401b030 tx=0x7fdf84019720 comp rx=0 tx=0).stop 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 shutdown_connections 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c149070 0x7fdf8c1e3b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf8c0b5d70 0x7fdf8c1e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 --2- 172.21.15.40:0/1519978486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf8c0b2c50 0x7fdf8c144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 >> 172.21.15.40:0/1519978486 conn(0x7fdf8c06b6c0 msgr2=0x7fdf8c13e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 shutdown_connections 2024-05-12T22:52:47.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.267+0000 7fdf926b8640 1 -- 172.21.15.40:0/1519978486 wait complete. 2024-05-12T22:52:47.284 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-12T22:52:45.348147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234660,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740060,"statfs":{"total":773094113280,"available":772853821440,"internally_reserved":0,"allocated":1867776,"data_stored":1766364,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.821912"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286162+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:52:37.286162+0000","last_peered":"2024-05-12T22:52:37.286162+0000","last_clean":"2024-05-12T22:52:37.286162+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:52:37.286162+0000","last_undegraded":"2024-05-12T22:52:37.286162+0000","last_fullsized":"2024-05-12T22:52:37.286162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551378+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:36.551378+0000","last_peered":"2024-05-12T22:52:36.551378+0000","last_clean":"2024-05-12T22:52:36.551378+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:36.551378+0000","last_undegraded":"2024-05-12T22:52:36.551378+0000","last_fullsized":"2024-05-12T22:52:36.551378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286612+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:37.286612+0000","last_peered":"2024-05-12T22:52:37.286612+0000","last_clean":"2024-05-12T22:52:37.286612+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:37.286612+0000","last_undegraded":"2024-05-12T22:52:37.286612+0000","last_fullsized":"2024-05-12T22:52:37.286612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555056+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:52:36.555056+0000","last_peered":"2024-05-12T22:52:36.555056+0000","last_clean":"2024-05-12T22:52:36.555056+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:52:36.555056+0000","last_undegraded":"2024-05-12T22:52:36.555056+0000","last_fullsized":"2024-05-12T22:52:36.555056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285942+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:52:37.285942+0000","last_peered":"2024-05-12T22:52:37.285942+0000","last_clean":"2024-05-12T22:52:37.285942+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:52:37.285942+0000","last_undegraded":"2024-05-12T22:52:37.285942+0000","last_fullsized":"2024-05-12T22:52:37.285942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553561+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:52:36.553561+0000","last_peered":"2024-05-12T22:52:36.553561+0000","last_clean":"2024-05-12T22:52:36.553561+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:52:36.553561+0000","last_undegraded":"2024-05-12T22:52:36.553561+0000","last_fullsized":"2024-05-12T22:52:36.553561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285020+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:52:37.285020+0000","last_peered":"2024-05-12T22:52:37.285020+0000","last_clean":"2024-05-12T22:52:37.285020+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:52:37.285020+0000","last_undegraded":"2024-05-12T22:52:37.285020+0000","last_fullsized":"2024-05-12T22:52:37.285020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285378+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:37.285378+0000","last_peered":"2024-05-12T22:52:37.285378+0000","last_clean":"2024-05-12T22:52:37.285378+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:37.285378+0000","last_undegraded":"2024-05-12T22:52:37.285378+0000","last_fullsized":"2024-05-12T22:52:37.285378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286375+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:52:37.286375+0000","last_peered":"2024-05-12T22:52:37.286375+0000","last_clean":"2024-05-12T22:52:37.286375+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:52:37.286375+0000","last_undegraded":"2024-05-12T22:52:37.286375+0000","last_fullsized":"2024-05-12T22:52:37.286375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806705+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:52:36.806705+0000","last_peered":"2024-05-12T22:52:36.806705+0000","last_clean":"2024-05-12T22:52:36.806705+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:52:36.806705+0000","last_undegraded":"2024-05-12T22:52:36.806705+0000","last_fullsized":"2024-05-12T22:52:36.806705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806145+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:52:36.806145+0000","last_peered":"2024-05-12T22:52:36.806145+0000","last_clean":"2024-05-12T22:52:36.806145+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:52:36.806145+0000","last_undegraded":"2024-05-12T22:52:36.806145+0000","last_fullsized":"2024-05-12T22:52:36.806145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554295+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:52:36.554295+0000","last_peered":"2024-05-12T22:52:36.554295+0000","last_clean":"2024-05-12T22:52:36.554295+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:52:36.554295+0000","last_undegraded":"2024-05-12T22:52:36.554295+0000","last_fullsized":"2024-05-12T22:52:36.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287290+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:37.287290+0000","last_peered":"2024-05-12T22:52:37.287290+0000","last_clean":"2024-05-12T22:52:37.287290+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:37.287290+0000","last_undegraded":"2024-05-12T22:52:37.287290+0000","last_fullsized":"2024-05-12T22:52:37.287290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284847+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:37.284847+0000","last_peered":"2024-05-12T22:52:37.284847+0000","last_clean":"2024-05-12T22:52:37.284847+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:37.284847+0000","last_undegraded":"2024-05-12T22:52:37.284847+0000","last_fullsized":"2024-05-12T22:52:37.284847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550921+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:36.550921+0000","last_peered":"2024-05-12T22:52:36.550921+0000","last_clean":"2024-05-12T22:52:36.550921+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:36.550921+0000","last_undegraded":"2024-05-12T22:52:36.550921+0000","last_fullsized":"2024-05-12T22:52:36.550921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552642+0000","last_change":"2024-05-12T22:52:35.564819+0000","last_active":"2024-05-12T22:52:36.552642+0000","last_peered":"2024-05-12T22:52:36.552642+0000","last_clean":"2024-05-12T22:52:36.552642+0000","last_became_active":"2024-05-12T22:52:35.564023+0000","last_became_peered":"2024-05-12T22:52:35.564023+0000","last_unstale":"2024-05-12T22:52:36.552642+0000","last_undegraded":"2024-05-12T22:52:36.552642+0000","last_fullsized":"2024-05-12T22:52:36.552642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556489+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:52:36.556489+0000","last_peered":"2024-05-12T22:52:36.556489+0000","last_clean":"2024-05-12T22:52:36.556489+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:52:36.556489+0000","last_undegraded":"2024-05-12T22:52:36.556489+0000","last_fullsized":"2024-05-12T22:52:36.556489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987208+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:36.987208+0000","last_peered":"2024-05-12T22:52:36.987208+0000","last_clean":"2024-05-12T22:52:36.987208+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:36.987208+0000","last_undegraded":"2024-05-12T22:52:36.987208+0000","last_fullsized":"2024-05-12T22:52:36.987208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286105+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:52:37.286105+0000","last_peered":"2024-05-12T22:52:37.286105+0000","last_clean":"2024-05-12T22:52:37.286105+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:52:37.286105+0000","last_undegraded":"2024-05-12T22:52:37.286105+0000","last_fullsized":"2024-05-12T22:52:37.286105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806066+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:52:36.806066+0000","last_peered":"2024-05-12T22:52:36.806066+0000","last_clean":"2024-05-12T22:52:36.806066+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:52:36.806066+0000","last_undegraded":"2024-05-12T22:52:36.806066+0000","last_fullsized":"2024-05-12T22:52:36.806066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285172+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:37.285172+0000","last_peered":"2024-05-12T22:52:37.285172+0000","last_clean":"2024-05-12T22:52:37.285172+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:37.285172+0000","last_undegraded":"2024-05-12T22:52:37.285172+0000","last_fullsized":"2024-05-12T22:52:37.285172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555032+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:52:36.555032+0000","last_peered":"2024-05-12T22:52:36.555032+0000","last_clean":"2024-05-12T22:52:36.555032+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:52:36.555032+0000","last_undegraded":"2024-05-12T22:52:36.555032+0000","last_fullsized":"2024-05-12T22:52:36.555032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285332+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:37.285332+0000","last_peered":"2024-05-12T22:52:37.285332+0000","last_clean":"2024-05-12T22:52:37.285332+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:37.285332+0000","last_undegraded":"2024-05-12T22:52:37.285332+0000","last_fullsized":"2024-05-12T22:52:37.285332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552901+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:52:36.552901+0000","last_peered":"2024-05-12T22:52:36.552901+0000","last_clean":"2024-05-12T22:52:36.552901+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:52:36.552901+0000","last_undegraded":"2024-05-12T22:52:36.552901+0000","last_fullsized":"2024-05-12T22:52:36.552901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287121+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:37.287121+0000","last_peered":"2024-05-12T22:52:37.287121+0000","last_clean":"2024-05-12T22:52:37.287121+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:37.287121+0000","last_undegraded":"2024-05-12T22:52:37.287121+0000","last_fullsized":"2024-05-12T22:52:37.287121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806703+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:52:36.806703+0000","last_peered":"2024-05-12T22:52:36.806703+0000","last_clean":"2024-05-12T22:52:36.806703+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:52:36.806703+0000","last_undegraded":"2024-05-12T22:52:36.806703+0000","last_fullsized":"2024-05-12T22:52:36.806703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551505+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:36.551505+0000","last_peered":"2024-05-12T22:52:36.551505+0000","last_clean":"2024-05-12T22:52:36.551505+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:36.551505+0000","last_undegraded":"2024-05-12T22:52:36.551505+0000","last_fullsized":"2024-05-12T22:52:36.551505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286023+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:37.286023+0000","last_peered":"2024-05-12T22:52:37.286023+0000","last_clean":"2024-05-12T22:52:37.286023+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:37.286023+0000","last_undegraded":"2024-05-12T22:52:37.286023+0000","last_fullsized":"2024-05-12T22:52:37.286023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285576+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:37.285576+0000","last_peered":"2024-05-12T22:52:37.285576+0000","last_clean":"2024-05-12T22:52:37.285576+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:37.285576+0000","last_undegraded":"2024-05-12T22:52:37.285576+0000","last_fullsized":"2024-05-12T22:52:37.285576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555256+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:52:36.555256+0000","last_peered":"2024-05-12T22:52:36.555256+0000","last_clean":"2024-05-12T22:52:36.555256+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:52:36.555256+0000","last_undegraded":"2024-05-12T22:52:36.555256+0000","last_fullsized":"2024-05-12T22:52:36.555256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986926+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:36.986926+0000","last_peered":"2024-05-12T22:52:36.986926+0000","last_clean":"2024-05-12T22:52:36.986926+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:36.986926+0000","last_undegraded":"2024-05-12T22:52:36.986926+0000","last_fullsized":"2024-05-12T22:52:36.986926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805653+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:52:36.805653+0000","last_peered":"2024-05-12T22:52:36.805653+0000","last_clean":"2024-05-12T22:52:36.805653+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:52:36.805653+0000","last_undegraded":"2024-05-12T22:52:36.805653+0000","last_fullsized":"2024-05-12T22:52:36.805653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553533+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:52:36.553533+0000","last_peered":"2024-05-12T22:52:36.553533+0000","last_clean":"2024-05-12T22:52:36.553533+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:52:36.553533+0000","last_undegraded":"2024-05-12T22:52:36.553533+0000","last_fullsized":"2024-05-12T22:52:36.553533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287541+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:37.287541+0000","last_peered":"2024-05-12T22:52:37.287541+0000","last_clean":"2024-05-12T22:52:37.287541+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:37.287541+0000","last_undegraded":"2024-05-12T22:52:37.287541+0000","last_fullsized":"2024-05-12T22:52:37.287541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285950+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:37.285950+0000","last_peered":"2024-05-12T22:52:37.285950+0000","last_clean":"2024-05-12T22:52:37.285950+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:37.285950+0000","last_undegraded":"2024-05-12T22:52:37.285950+0000","last_fullsized":"2024-05-12T22:52:37.285950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805673+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:52:36.805673+0000","last_peered":"2024-05-12T22:52:36.805673+0000","last_clean":"2024-05-12T22:52:36.805673+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:52:36.805673+0000","last_undegraded":"2024-05-12T22:52:36.805673+0000","last_fullsized":"2024-05-12T22:52:36.805673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285789+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:37.285789+0000","last_peered":"2024-05-12T22:52:37.285789+0000","last_clean":"2024-05-12T22:52:37.285789+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:37.285789+0000","last_undegraded":"2024-05-12T22:52:37.285789+0000","last_fullsized":"2024-05-12T22:52:37.285789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285786+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:37.285786+0000","last_peered":"2024-05-12T22:52:37.285786+0000","last_clean":"2024-05-12T22:52:37.285786+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:37.285786+0000","last_undegraded":"2024-05-12T22:52:37.285786+0000","last_fullsized":"2024-05-12T22:52:37.285786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553079+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:52:36.553079+0000","last_peered":"2024-05-12T22:52:36.553079+0000","last_clean":"2024-05-12T22:52:36.553079+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:52:36.553079+0000","last_undegraded":"2024-05-12T22:52:36.553079+0000","last_fullsized":"2024-05-12T22:52:36.553079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550955+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:36.550955+0000","last_peered":"2024-05-12T22:52:36.550955+0000","last_clean":"2024-05-12T22:52:36.550955+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:36.550955+0000","last_undegraded":"2024-05-12T22:52:36.550955+0000","last_fullsized":"2024-05-12T22:52:36.550955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806416+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:52:36.806416+0000","last_peered":"2024-05-12T22:52:36.806416+0000","last_clean":"2024-05-12T22:52:36.806416+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:52:36.806416+0000","last_undegraded":"2024-05-12T22:52:36.806416+0000","last_fullsized":"2024-05-12T22:52:36.806416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556220+0000","last_change":"2024-05-12T22:52:35.573997+0000","last_active":"2024-05-12T22:52:36.556220+0000","last_peered":"2024-05-12T22:52:36.556220+0000","last_clean":"2024-05-12T22:52:36.556220+0000","last_became_active":"2024-05-12T22:52:35.573264+0000","last_became_peered":"2024-05-12T22:52:35.573264+0000","last_unstale":"2024-05-12T22:52:36.556220+0000","last_undegraded":"2024-05-12T22:52:36.556220+0000","last_fullsized":"2024-05-12T22:52:36.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556467+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:52:36.556467+0000","last_peered":"2024-05-12T22:52:36.556467+0000","last_clean":"2024-05-12T22:52:36.556467+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:52:36.556467+0000","last_undegraded":"2024-05-12T22:52:36.556467+0000","last_fullsized":"2024-05-12T22:52:36.556467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286491+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:37.286491+0000","last_peered":"2024-05-12T22:52:37.286491+0000","last_clean":"2024-05-12T22:52:37.286491+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:37.286491+0000","last_undegraded":"2024-05-12T22:52:37.286491+0000","last_fullsized":"2024-05-12T22:52:37.286491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551240+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:36.551240+0000","last_peered":"2024-05-12T22:52:36.551240+0000","last_clean":"2024-05-12T22:52:36.551240+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:36.551240+0000","last_undegraded":"2024-05-12T22:52:36.551240+0000","last_fullsized":"2024-05-12T22:52:36.551240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554358+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:52:36.554358+0000","last_peered":"2024-05-12T22:52:36.554358+0000","last_clean":"2024-05-12T22:52:36.554358+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:52:36.554358+0000","last_undegraded":"2024-05-12T22:52:36.554358+0000","last_fullsized":"2024-05-12T22:52:36.554358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805922+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:52:36.805922+0000","last_peered":"2024-05-12T22:52:36.805922+0000","last_clean":"2024-05-12T22:52:36.805922+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:52:36.805922+0000","last_undegraded":"2024-05-12T22:52:36.805922+0000","last_fullsized":"2024-05-12T22:52:36.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285389+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:52:37.285389+0000","last_peered":"2024-05-12T22:52:37.285389+0000","last_clean":"2024-05-12T22:52:37.285389+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:52:37.285389+0000","last_undegraded":"2024-05-12T22:52:37.285389+0000","last_fullsized":"2024-05-12T22:52:37.285389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285931+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:37.285931+0000","last_peered":"2024-05-12T22:52:37.285931+0000","last_clean":"2024-05-12T22:52:37.285931+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:37.285931+0000","last_undegraded":"2024-05-12T22:52:37.285931+0000","last_fullsized":"2024-05-12T22:52:37.285931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285269+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:37.285269+0000","last_peered":"2024-05-12T22:52:37.285269+0000","last_clean":"2024-05-12T22:52:37.285269+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:37.285269+0000","last_undegraded":"2024-05-12T22:52:37.285269+0000","last_fullsized":"2024-05-12T22:52:37.285269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555310+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:52:36.555310+0000","last_peered":"2024-05-12T22:52:36.555310+0000","last_clean":"2024-05-12T22:52:36.555310+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:52:36.555310+0000","last_undegraded":"2024-05-12T22:52:36.555310+0000","last_fullsized":"2024-05-12T22:52:36.555310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285573+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:52:37.285573+0000","last_peered":"2024-05-12T22:52:37.285573+0000","last_clean":"2024-05-12T22:52:37.285573+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:52:37.285573+0000","last_undegraded":"2024-05-12T22:52:37.285573+0000","last_fullsized":"2024-05-12T22:52:37.285573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805974+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:52:36.805974+0000","last_peered":"2024-05-12T22:52:36.805974+0000","last_clean":"2024-05-12T22:52:36.805974+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:52:36.805974+0000","last_undegraded":"2024-05-12T22:52:36.805974+0000","last_fullsized":"2024-05-12T22:52:36.805974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805837+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:52:36.805837+0000","last_peered":"2024-05-12T22:52:36.805837+0000","last_clean":"2024-05-12T22:52:36.805837+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:52:36.805837+0000","last_undegraded":"2024-05-12T22:52:36.805837+0000","last_fullsized":"2024-05-12T22:52:36.805837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986661+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:36.986661+0000","last_peered":"2024-05-12T22:52:36.986661+0000","last_clean":"2024-05-12T22:52:36.986661+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:36.986661+0000","last_undegraded":"2024-05-12T22:52:36.986661+0000","last_fullsized":"2024-05-12T22:52:36.986661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285096+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:52:37.285096+0000","last_peered":"2024-05-12T22:52:37.285096+0000","last_clean":"2024-05-12T22:52:37.285096+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:52:37.285096+0000","last_undegraded":"2024-05-12T22:52:37.285096+0000","last_fullsized":"2024-05-12T22:52:37.285096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554755+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:52:36.554755+0000","last_peered":"2024-05-12T22:52:36.554755+0000","last_clean":"2024-05-12T22:52:36.554755+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:52:36.554755+0000","last_undegraded":"2024-05-12T22:52:36.554755+0000","last_fullsized":"2024-05-12T22:52:36.554755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285734+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:52:37.285734+0000","last_peered":"2024-05-12T22:52:37.285734+0000","last_clean":"2024-05-12T22:52:37.285734+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:52:37.285734+0000","last_undegraded":"2024-05-12T22:52:37.285734+0000","last_fullsized":"2024-05-12T22:52:37.285734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987315+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:36.987315+0000","last_peered":"2024-05-12T22:52:36.987315+0000","last_clean":"2024-05-12T22:52:36.987315+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:36.987315+0000","last_undegraded":"2024-05-12T22:52:36.987315+0000","last_fullsized":"2024-05-12T22:52:36.987315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286529+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:52:37.286529+0000","last_peered":"2024-05-12T22:52:37.286529+0000","last_clean":"2024-05-12T22:52:37.286529+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:52:37.286529+0000","last_undegraded":"2024-05-12T22:52:37.286529+0000","last_fullsized":"2024-05-12T22:52:37.286529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551350+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:36.551350+0000","last_peered":"2024-05-12T22:52:36.551350+0000","last_clean":"2024-05-12T22:52:36.551350+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:36.551350+0000","last_undegraded":"2024-05-12T22:52:36.551350+0000","last_fullsized":"2024-05-12T22:52:36.551350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555376+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:52:36.555376+0000","last_peered":"2024-05-12T22:52:36.555376+0000","last_clean":"2024-05-12T22:52:36.555376+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:52:36.555376+0000","last_undegraded":"2024-05-12T22:52:36.555376+0000","last_fullsized":"2024-05-12T22:52:36.555376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987063+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:36.987063+0000","last_peered":"2024-05-12T22:52:36.987063+0000","last_clean":"2024-05-12T22:52:36.987063+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:36.987063+0000","last_undegraded":"2024-05-12T22:52:36.987063+0000","last_fullsized":"2024-05-12T22:52:36.987063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285638+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:52:37.285638+0000","last_peered":"2024-05-12T22:52:37.285638+0000","last_clean":"2024-05-12T22:52:37.285638+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:52:37.285638+0000","last_undegraded":"2024-05-12T22:52:37.285638+0000","last_fullsized":"2024-05-12T22:52:37.285638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284734+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:37.284734+0000","last_peered":"2024-05-12T22:52:37.284734+0000","last_clean":"2024-05-12T22:52:37.284734+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:37.284734+0000","last_undegraded":"2024-05-12T22:52:37.284734+0000","last_fullsized":"2024-05-12T22:52:37.284734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554095+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:52:36.554095+0000","last_peered":"2024-05-12T22:52:36.554095+0000","last_clean":"2024-05-12T22:52:36.554095+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:52:36.554095+0000","last_undegraded":"2024-05-12T22:52:36.554095+0000","last_fullsized":"2024-05-12T22:52:36.554095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285580+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:37.285580+0000","last_peered":"2024-05-12T22:52:37.285580+0000","last_clean":"2024-05-12T22:52:37.285580+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:37.285580+0000","last_undegraded":"2024-05-12T22:52:37.285580+0000","last_fullsized":"2024-05-12T22:52:37.285580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284582+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:52:37.284582+0000","last_peered":"2024-05-12T22:52:37.284582+0000","last_clean":"2024-05-12T22:52:37.284582+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:52:37.284582+0000","last_undegraded":"2024-05-12T22:52:37.284582+0000","last_fullsized":"2024-05-12T22:52:37.284582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284790+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:37.284790+0000","last_peered":"2024-05-12T22:52:37.284790+0000","last_clean":"2024-05-12T22:52:37.284790+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:37.284790+0000","last_undegraded":"2024-05-12T22:52:37.284790+0000","last_fullsized":"2024-05-12T22:52:37.284790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986949+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:36.986949+0000","last_peered":"2024-05-12T22:52:36.986949+0000","last_clean":"2024-05-12T22:52:36.986949+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:36.986949+0000","last_undegraded":"2024-05-12T22:52:36.986949+0000","last_fullsized":"2024-05-12T22:52:36.986949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550923+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:36.550923+0000","last_peered":"2024-05-12T22:52:36.550923+0000","last_clean":"2024-05-12T22:52:36.550923+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:36.550923+0000","last_undegraded":"2024-05-12T22:52:36.550923+0000","last_fullsized":"2024-05-12T22:52:36.550923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555532+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:52:36.555532+0000","last_peered":"2024-05-12T22:52:36.555532+0000","last_clean":"2024-05-12T22:52:36.555532+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:52:36.555532+0000","last_undegraded":"2024-05-12T22:52:36.555532+0000","last_fullsized":"2024-05-12T22:52:36.555532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553978+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:52:36.553978+0000","last_peered":"2024-05-12T22:52:36.553978+0000","last_clean":"2024-05-12T22:52:36.553978+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:52:36.553978+0000","last_undegraded":"2024-05-12T22:52:36.553978+0000","last_fullsized":"2024-05-12T22:52:36.553978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551249+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:36.551249+0000","last_peered":"2024-05-12T22:52:36.551249+0000","last_clean":"2024-05-12T22:52:36.551249+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:36.551249+0000","last_undegraded":"2024-05-12T22:52:36.551249+0000","last_fullsized":"2024-05-12T22:52:36.551249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556158+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:52:36.556158+0000","last_peered":"2024-05-12T22:52:36.556158+0000","last_clean":"2024-05-12T22:52:36.556158+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:52:36.556158+0000","last_undegraded":"2024-05-12T22:52:36.556158+0000","last_fullsized":"2024-05-12T22:52:36.556158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285916+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:52:37.285916+0000","last_peered":"2024-05-12T22:52:37.285916+0000","last_clean":"2024-05-12T22:52:37.285916+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:52:37.285916+0000","last_undegraded":"2024-05-12T22:52:37.285916+0000","last_fullsized":"2024-05-12T22:52:37.285916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551253+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:36.551253+0000","last_peered":"2024-05-12T22:52:36.551253+0000","last_clean":"2024-05-12T22:52:36.551253+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:36.551253+0000","last_undegraded":"2024-05-12T22:52:36.551253+0000","last_fullsized":"2024-05-12T22:52:36.551253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551448+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:36.551448+0000","last_peered":"2024-05-12T22:52:36.551448+0000","last_clean":"2024-05-12T22:52:36.551448+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:36.551448+0000","last_undegraded":"2024-05-12T22:52:36.551448+0000","last_fullsized":"2024-05-12T22:52:36.551448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287370+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:37.287370+0000","last_peered":"2024-05-12T22:52:37.287370+0000","last_clean":"2024-05-12T22:52:37.287370+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:37.287370+0000","last_undegraded":"2024-05-12T22:52:37.287370+0000","last_fullsized":"2024-05-12T22:52:37.287370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806544+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:52:36.806544+0000","last_peered":"2024-05-12T22:52:36.806544+0000","last_clean":"2024-05-12T22:52:36.806544+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:52:36.806544+0000","last_undegraded":"2024-05-12T22:52:36.806544+0000","last_fullsized":"2024-05-12T22:52:36.806544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284624+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:52:37.284624+0000","last_peered":"2024-05-12T22:52:37.284624+0000","last_clean":"2024-05-12T22:52:37.284624+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:52:37.284624+0000","last_undegraded":"2024-05-12T22:52:37.284624+0000","last_fullsized":"2024-05-12T22:52:37.284624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552899+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:52:36.552899+0000","last_peered":"2024-05-12T22:52:36.552899+0000","last_clean":"2024-05-12T22:52:36.552899+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:52:36.552899+0000","last_undegraded":"2024-05-12T22:52:36.552899+0000","last_fullsized":"2024-05-12T22:52:36.552899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551027+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:36.551027+0000","last_peered":"2024-05-12T22:52:36.551027+0000","last_clean":"2024-05-12T22:52:36.551027+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:36.551027+0000","last_undegraded":"2024-05-12T22:52:36.551027+0000","last_fullsized":"2024-05-12T22:52:36.551027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286426+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:37.286426+0000","last_peered":"2024-05-12T22:52:37.286426+0000","last_clean":"2024-05-12T22:52:37.286426+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:37.286426+0000","last_undegraded":"2024-05-12T22:52:37.286426+0000","last_fullsized":"2024-05-12T22:52:37.286426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551214+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:36.551214+0000","last_peered":"2024-05-12T22:52:36.551214+0000","last_clean":"2024-05-12T22:52:36.551214+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:36.551214+0000","last_undegraded":"2024-05-12T22:52:36.551214+0000","last_fullsized":"2024-05-12T22:52:36.551214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287516+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:37.287516+0000","last_peered":"2024-05-12T22:52:37.287516+0000","last_clean":"2024-05-12T22:52:37.287516+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:37.287516+0000","last_undegraded":"2024-05-12T22:52:37.287516+0000","last_fullsized":"2024-05-12T22:52:37.287516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286053+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:52:37.286053+0000","last_peered":"2024-05-12T22:52:37.286053+0000","last_clean":"2024-05-12T22:52:37.286053+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:52:37.286053+0000","last_undegraded":"2024-05-12T22:52:37.286053+0000","last_fullsized":"2024-05-12T22:52:37.286053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806064+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:52:36.806064+0000","last_peered":"2024-05-12T22:52:36.806064+0000","last_clean":"2024-05-12T22:52:36.806064+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:52:36.806064+0000","last_undegraded":"2024-05-12T22:52:36.806064+0000","last_fullsized":"2024-05-12T22:52:36.806064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555992+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:52:36.555992+0000","last_peered":"2024-05-12T22:52:36.555992+0000","last_clean":"2024-05-12T22:52:36.555992+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:52:36.555992+0000","last_undegraded":"2024-05-12T22:52:36.555992+0000","last_fullsized":"2024-05-12T22:52:36.555992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285271+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:52:37.285271+0000","last_peered":"2024-05-12T22:52:37.285271+0000","last_clean":"2024-05-12T22:52:37.285271+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:52:37.285271+0000","last_undegraded":"2024-05-12T22:52:37.285271+0000","last_fullsized":"2024-05-12T22:52:37.285271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555168+0000","last_change":"2024-05-12T22:52:35.597304+0000","last_active":"2024-05-12T22:52:36.555168+0000","last_peered":"2024-05-12T22:52:36.555168+0000","last_clean":"2024-05-12T22:52:36.555168+0000","last_became_active":"2024-05-12T22:52:35.596833+0000","last_became_peered":"2024-05-12T22:52:35.596833+0000","last_unstale":"2024-05-12T22:52:36.555168+0000","last_undegraded":"2024-05-12T22:52:36.555168+0000","last_fullsized":"2024-05-12T22:52:36.555168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285683+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:52:37.285683+0000","last_peered":"2024-05-12T22:52:37.285683+0000","last_clean":"2024-05-12T22:52:37.285683+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:52:37.285683+0000","last_undegraded":"2024-05-12T22:52:37.285683+0000","last_fullsized":"2024-05-12T22:52:37.285683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286235+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:37.286235+0000","last_peered":"2024-05-12T22:52:37.286235+0000","last_clean":"2024-05-12T22:52:37.286235+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:37.286235+0000","last_undegraded":"2024-05-12T22:52:37.286235+0000","last_fullsized":"2024-05-12T22:52:37.286235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286968+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:37.286968+0000","last_peered":"2024-05-12T22:52:37.286968+0000","last_clean":"2024-05-12T22:52:37.286968+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:37.286968+0000","last_undegraded":"2024-05-12T22:52:37.286968+0000","last_fullsized":"2024-05-12T22:52:37.286968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286636+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:37.286636+0000","last_peered":"2024-05-12T22:52:37.286636+0000","last_clean":"2024-05-12T22:52:37.286636+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:37.286636+0000","last_undegraded":"2024-05-12T22:52:37.286636+0000","last_fullsized":"2024-05-12T22:52:37.286636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":663551,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":72691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":72727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":72601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":663607,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:47.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:52:47.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 Processor -- start 2024-05-12T22:52:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 -- start start 2024-05-12T22:52:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 0x7fc9a813f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80b6150 con 0x7fc9a80b2c50 2024-05-12T22:52:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a806f620 con 0x7fc9a80b5d70 2024-05-12T22:52:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.447+0000 7fc9b07d7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a806f990 con 0x7fc9a8149070 2024-05-12T22:52:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9aed74640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc9a80b2c50 0x7fc9a814fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51738/0 (socket says 172.21.15.40:51738) 2024-05-12T22:52:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9aed74640 1 -- 172.21.15.40:0/2183663677 learned_addr learned my addr 172.21.15.40:0/2183663677 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 0x7fc9a813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976173860 0 0) 0x7fc9a80b6150 con 0x7fc9a80b2c50 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc994003530 con 0x7fc9a80b2c50 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1991508571 0 0) 0x7fc994003530 con 0x7fc9a80b2c50 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 msgr2=0x7fc9a813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 0x7fc9a813f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 >> v1:172.21.15.47:6789/0 conn(0x7fc9a80b5d70 legacy=0x7fc9a8148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80b4ea0 con 0x7fc9a80b2c50 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fc9a0001680 con 0x7fc9a80b2c50 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 >> v1:172.21.15.40:6789/0 conn(0x7fc9a80b2c50 legacy=0x7fc9a814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9940039f0 0x7fc994003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc994004810 0x7fc994004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 0x7fc994005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400bb60 con 0x7fc994004810 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400bce0 con 0x7fc9940039f0 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc99400beb0 con 0x7fc9a8149070 2024-05-12T22:52:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc994004810 0x7fc994004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ae573640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9940039f0 0x7fc994003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 -- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 msgr2=0x7fc994005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a8149070 0x7fc994005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 -- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9940039f0 msgr2=0x7fc994003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9940039f0 0x7fc994003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 -- 172.21.15.40:0/2183663677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc994003530 con 0x7fc994004810 2024-05-12T22:52:47.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9add72640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc994004810 0x7fc994004c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ae0 tx=0x7fc99801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ac2bc06c2b8dae server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980b2070 con 0x7fc994004810 2024-05-12T22:52:47.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9980a5660 con 0x7fc994004810 2024-05-12T22:52:47.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9ad571640 1 -- 172.21.15.40:0/2183663677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980096b0 con 0x7fc994004810 2024-05-12T22:52:47.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 -- 172.21.15.40:0/2183663677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc994004810 msgr2=0x7fc994004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/2183663677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc994004810 0x7fc994004c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ae0 tx=0x7fc99801ca70 comp rx=0 tx=0).stop 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9aed74640 1 -- 172.21.15.40:0/2183663677 reap_dead start 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 -- 172.21.15.40:0/2183663677 shutdown_connections 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 -- 172.21.15.40:0/2183663677 >> 172.21.15.40:0/2183663677 conn(0x7fc9a806b6c0 msgr2=0x7fc9a806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 -- 172.21.15.40:0/2183663677 shutdown_connections 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.451+0000 7fc9b07d7640 1 -- 172.21.15.40:0/2183663677 wait complete. 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 Processor -- start 2024-05-12T22:52:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- start start 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc994004810 0x7fc9a814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a814aff0 0x7fc9a8149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8151c80 con 0x7fc9a8149ad0 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80708b0 con 0x7fc994004810 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a8151e00 con 0x7fc9a814aff0 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60384/0 (socket says 172.21.15.40:60384) 2024-05-12T22:52:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 -- 172.21.15.40:0/1913614393 learned_addr learned my addr 172.21.15.40:0/1913614393 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9add72640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a814aff0 0x7fc9a8149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9ae573640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc994004810 0x7fc9a814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 -- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a814aff0 msgr2=0x7fc9a8149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a814aff0 0x7fc9a8149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 -- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc994004810 msgr2=0x7fc9a814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc994004810 0x7fc9a814aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 -- 172.21.15.40:0/1913614393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a81e1fc0 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9aed74640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80affc0 tx=0x7fc9a000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0007230 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a00073f0 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8149f50 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00047f0 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81e2520 con 0x7fc9a8149ad0 2024-05-12T22:52:47.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8068330 con 0x7fc9a8149ad0 2024-05-12T22:52:47.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.455+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9a0004990 con 0x7fc9a8149ad0 2024-05-12T22:52:47.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.459+0000 7fc99effd640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 0x7fc98c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.459+0000 7fc9ae573640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 0x7fc98c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.459+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a0085310 con 0x7fc9a8149ad0 2024-05-12T22:52:47.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.459+0000 7fc9ae573640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 0x7fc98c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40051f0 tx=0x7fc9a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.463+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc9a8149f50 con 0x7fc9a8149ad0 2024-05-12T22:52:47.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.615+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9a814b900 con 0x7fc98c0678c0 2024-05-12T22:52:47.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.619+0000 7fc99effd640 1 -- 172.21.15.40:0/1913614393 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251912 (secure 0 0 0) 0x7fc9a814b900 con 0x7fc98c0678c0 2024-05-12T22:52:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:47.625 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 msgr2=0x7fc98c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 0x7fc98c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40051f0 tx=0x7fc9a4009040 comp rx=0 tx=0).stop 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 msgr2=0x7fc9a8139dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80affc0 tx=0x7fc9a000cb90 comp rx=0 tx=0).stop 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 shutdown_connections 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9a8149ad0 0x7fc9a8139dd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc9a814aff0 0x7fc9a8149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc98c0678c0 0x7fc98c069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 --2- 172.21.15.40:0/1913614393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc994004810 0x7fc9a814aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 >> 172.21.15.40:0/1913614393 conn(0x7fc9a806b6c0 msgr2=0x7fc9a8143a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:47.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 shutdown_connections 2024-05-12T22:52:47.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.623+0000 7fc9b07d7640 1 -- 172.21.15.40:0/1913614393 wait complete. 2024-05-12T22:52:47.641 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-12T22:52:47.348583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234660,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740060,"statfs":{"total":773094113280,"available":772853821440,"internally_reserved":0,"allocated":1867776,"data_stored":1766364,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12747,"internal_metadata":238276149},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.799878"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286162+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:52:37.286162+0000","last_peered":"2024-05-12T22:52:37.286162+0000","last_clean":"2024-05-12T22:52:37.286162+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:52:37.286162+0000","last_undegraded":"2024-05-12T22:52:37.286162+0000","last_fullsized":"2024-05-12T22:52:37.286162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551378+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:52:36.551378+0000","last_peered":"2024-05-12T22:52:36.551378+0000","last_clean":"2024-05-12T22:52:36.551378+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:52:36.551378+0000","last_undegraded":"2024-05-12T22:52:36.551378+0000","last_fullsized":"2024-05-12T22:52:36.551378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286612+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:52:37.286612+0000","last_peered":"2024-05-12T22:52:37.286612+0000","last_clean":"2024-05-12T22:52:37.286612+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:52:37.286612+0000","last_undegraded":"2024-05-12T22:52:37.286612+0000","last_fullsized":"2024-05-12T22:52:37.286612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555056+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:52:36.555056+0000","last_peered":"2024-05-12T22:52:36.555056+0000","last_clean":"2024-05-12T22:52:36.555056+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:52:36.555056+0000","last_undegraded":"2024-05-12T22:52:36.555056+0000","last_fullsized":"2024-05-12T22:52:36.555056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285942+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:52:37.285942+0000","last_peered":"2024-05-12T22:52:37.285942+0000","last_clean":"2024-05-12T22:52:37.285942+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:52:37.285942+0000","last_undegraded":"2024-05-12T22:52:37.285942+0000","last_fullsized":"2024-05-12T22:52:37.285942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553561+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:52:36.553561+0000","last_peered":"2024-05-12T22:52:36.553561+0000","last_clean":"2024-05-12T22:52:36.553561+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:52:36.553561+0000","last_undegraded":"2024-05-12T22:52:36.553561+0000","last_fullsized":"2024-05-12T22:52:36.553561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285020+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:52:37.285020+0000","last_peered":"2024-05-12T22:52:37.285020+0000","last_clean":"2024-05-12T22:52:37.285020+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:52:37.285020+0000","last_undegraded":"2024-05-12T22:52:37.285020+0000","last_fullsized":"2024-05-12T22:52:37.285020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285378+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:52:37.285378+0000","last_peered":"2024-05-12T22:52:37.285378+0000","last_clean":"2024-05-12T22:52:37.285378+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:52:37.285378+0000","last_undegraded":"2024-05-12T22:52:37.285378+0000","last_fullsized":"2024-05-12T22:52:37.285378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286375+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:52:37.286375+0000","last_peered":"2024-05-12T22:52:37.286375+0000","last_clean":"2024-05-12T22:52:37.286375+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:52:37.286375+0000","last_undegraded":"2024-05-12T22:52:37.286375+0000","last_fullsized":"2024-05-12T22:52:37.286375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806705+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:52:36.806705+0000","last_peered":"2024-05-12T22:52:36.806705+0000","last_clean":"2024-05-12T22:52:36.806705+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:52:36.806705+0000","last_undegraded":"2024-05-12T22:52:36.806705+0000","last_fullsized":"2024-05-12T22:52:36.806705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806145+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:52:36.806145+0000","last_peered":"2024-05-12T22:52:36.806145+0000","last_clean":"2024-05-12T22:52:36.806145+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:52:36.806145+0000","last_undegraded":"2024-05-12T22:52:36.806145+0000","last_fullsized":"2024-05-12T22:52:36.806145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554295+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:52:36.554295+0000","last_peered":"2024-05-12T22:52:36.554295+0000","last_clean":"2024-05-12T22:52:36.554295+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:52:36.554295+0000","last_undegraded":"2024-05-12T22:52:36.554295+0000","last_fullsized":"2024-05-12T22:52:36.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287290+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:52:37.287290+0000","last_peered":"2024-05-12T22:52:37.287290+0000","last_clean":"2024-05-12T22:52:37.287290+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:52:37.287290+0000","last_undegraded":"2024-05-12T22:52:37.287290+0000","last_fullsized":"2024-05-12T22:52:37.287290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284847+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:52:37.284847+0000","last_peered":"2024-05-12T22:52:37.284847+0000","last_clean":"2024-05-12T22:52:37.284847+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:52:37.284847+0000","last_undegraded":"2024-05-12T22:52:37.284847+0000","last_fullsized":"2024-05-12T22:52:37.284847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550921+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:52:36.550921+0000","last_peered":"2024-05-12T22:52:36.550921+0000","last_clean":"2024-05-12T22:52:36.550921+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:52:36.550921+0000","last_undegraded":"2024-05-12T22:52:36.550921+0000","last_fullsized":"2024-05-12T22:52:36.550921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552642+0000","last_change":"2024-05-12T22:52:35.564819+0000","last_active":"2024-05-12T22:52:36.552642+0000","last_peered":"2024-05-12T22:52:36.552642+0000","last_clean":"2024-05-12T22:52:36.552642+0000","last_became_active":"2024-05-12T22:52:35.564023+0000","last_became_peered":"2024-05-12T22:52:35.564023+0000","last_unstale":"2024-05-12T22:52:36.552642+0000","last_undegraded":"2024-05-12T22:52:36.552642+0000","last_fullsized":"2024-05-12T22:52:36.552642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556489+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:52:36.556489+0000","last_peered":"2024-05-12T22:52:36.556489+0000","last_clean":"2024-05-12T22:52:36.556489+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:52:36.556489+0000","last_undegraded":"2024-05-12T22:52:36.556489+0000","last_fullsized":"2024-05-12T22:52:36.556489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987208+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:52:36.987208+0000","last_peered":"2024-05-12T22:52:36.987208+0000","last_clean":"2024-05-12T22:52:36.987208+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:52:36.987208+0000","last_undegraded":"2024-05-12T22:52:36.987208+0000","last_fullsized":"2024-05-12T22:52:36.987208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286105+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:52:37.286105+0000","last_peered":"2024-05-12T22:52:37.286105+0000","last_clean":"2024-05-12T22:52:37.286105+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:52:37.286105+0000","last_undegraded":"2024-05-12T22:52:37.286105+0000","last_fullsized":"2024-05-12T22:52:37.286105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806066+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:52:36.806066+0000","last_peered":"2024-05-12T22:52:36.806066+0000","last_clean":"2024-05-12T22:52:36.806066+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:52:36.806066+0000","last_undegraded":"2024-05-12T22:52:36.806066+0000","last_fullsized":"2024-05-12T22:52:36.806066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285172+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:52:37.285172+0000","last_peered":"2024-05-12T22:52:37.285172+0000","last_clean":"2024-05-12T22:52:37.285172+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:52:37.285172+0000","last_undegraded":"2024-05-12T22:52:37.285172+0000","last_fullsized":"2024-05-12T22:52:37.285172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555032+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:52:36.555032+0000","last_peered":"2024-05-12T22:52:36.555032+0000","last_clean":"2024-05-12T22:52:36.555032+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:52:36.555032+0000","last_undegraded":"2024-05-12T22:52:36.555032+0000","last_fullsized":"2024-05-12T22:52:36.555032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285332+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:52:37.285332+0000","last_peered":"2024-05-12T22:52:37.285332+0000","last_clean":"2024-05-12T22:52:37.285332+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:52:37.285332+0000","last_undegraded":"2024-05-12T22:52:37.285332+0000","last_fullsized":"2024-05-12T22:52:37.285332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552901+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:52:36.552901+0000","last_peered":"2024-05-12T22:52:36.552901+0000","last_clean":"2024-05-12T22:52:36.552901+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:52:36.552901+0000","last_undegraded":"2024-05-12T22:52:36.552901+0000","last_fullsized":"2024-05-12T22:52:36.552901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287121+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:52:37.287121+0000","last_peered":"2024-05-12T22:52:37.287121+0000","last_clean":"2024-05-12T22:52:37.287121+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:52:37.287121+0000","last_undegraded":"2024-05-12T22:52:37.287121+0000","last_fullsized":"2024-05-12T22:52:37.287121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806703+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:52:36.806703+0000","last_peered":"2024-05-12T22:52:36.806703+0000","last_clean":"2024-05-12T22:52:36.806703+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:52:36.806703+0000","last_undegraded":"2024-05-12T22:52:36.806703+0000","last_fullsized":"2024-05-12T22:52:36.806703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551505+0000","last_change":"2024-05-12T22:52:35.546203+0000","last_active":"2024-05-12T22:52:36.551505+0000","last_peered":"2024-05-12T22:52:36.551505+0000","last_clean":"2024-05-12T22:52:36.551505+0000","last_became_active":"2024-05-12T22:52:35.545932+0000","last_became_peered":"2024-05-12T22:52:35.545932+0000","last_unstale":"2024-05-12T22:52:36.551505+0000","last_undegraded":"2024-05-12T22:52:36.551505+0000","last_fullsized":"2024-05-12T22:52:36.551505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286023+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:52:37.286023+0000","last_peered":"2024-05-12T22:52:37.286023+0000","last_clean":"2024-05-12T22:52:37.286023+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:52:37.286023+0000","last_undegraded":"2024-05-12T22:52:37.286023+0000","last_fullsized":"2024-05-12T22:52:37.286023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285576+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:52:37.285576+0000","last_peered":"2024-05-12T22:52:37.285576+0000","last_clean":"2024-05-12T22:52:37.285576+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:52:37.285576+0000","last_undegraded":"2024-05-12T22:52:37.285576+0000","last_fullsized":"2024-05-12T22:52:37.285576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555256+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:52:36.555256+0000","last_peered":"2024-05-12T22:52:36.555256+0000","last_clean":"2024-05-12T22:52:36.555256+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:52:36.555256+0000","last_undegraded":"2024-05-12T22:52:36.555256+0000","last_fullsized":"2024-05-12T22:52:36.555256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986926+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:52:36.986926+0000","last_peered":"2024-05-12T22:52:36.986926+0000","last_clean":"2024-05-12T22:52:36.986926+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:52:36.986926+0000","last_undegraded":"2024-05-12T22:52:36.986926+0000","last_fullsized":"2024-05-12T22:52:36.986926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805653+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:52:36.805653+0000","last_peered":"2024-05-12T22:52:36.805653+0000","last_clean":"2024-05-12T22:52:36.805653+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:52:36.805653+0000","last_undegraded":"2024-05-12T22:52:36.805653+0000","last_fullsized":"2024-05-12T22:52:36.805653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553533+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:52:36.553533+0000","last_peered":"2024-05-12T22:52:36.553533+0000","last_clean":"2024-05-12T22:52:36.553533+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:52:36.553533+0000","last_undegraded":"2024-05-12T22:52:36.553533+0000","last_fullsized":"2024-05-12T22:52:36.553533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287541+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:52:37.287541+0000","last_peered":"2024-05-12T22:52:37.287541+0000","last_clean":"2024-05-12T22:52:37.287541+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:52:37.287541+0000","last_undegraded":"2024-05-12T22:52:37.287541+0000","last_fullsized":"2024-05-12T22:52:37.287541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285950+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:52:37.285950+0000","last_peered":"2024-05-12T22:52:37.285950+0000","last_clean":"2024-05-12T22:52:37.285950+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:52:37.285950+0000","last_undegraded":"2024-05-12T22:52:37.285950+0000","last_fullsized":"2024-05-12T22:52:37.285950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805673+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:52:36.805673+0000","last_peered":"2024-05-12T22:52:36.805673+0000","last_clean":"2024-05-12T22:52:36.805673+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:52:36.805673+0000","last_undegraded":"2024-05-12T22:52:36.805673+0000","last_fullsized":"2024-05-12T22:52:36.805673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285789+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:52:37.285789+0000","last_peered":"2024-05-12T22:52:37.285789+0000","last_clean":"2024-05-12T22:52:37.285789+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:52:37.285789+0000","last_undegraded":"2024-05-12T22:52:37.285789+0000","last_fullsized":"2024-05-12T22:52:37.285789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285786+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:52:37.285786+0000","last_peered":"2024-05-12T22:52:37.285786+0000","last_clean":"2024-05-12T22:52:37.285786+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:52:37.285786+0000","last_undegraded":"2024-05-12T22:52:37.285786+0000","last_fullsized":"2024-05-12T22:52:37.285786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553079+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:52:36.553079+0000","last_peered":"2024-05-12T22:52:36.553079+0000","last_clean":"2024-05-12T22:52:36.553079+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:52:36.553079+0000","last_undegraded":"2024-05-12T22:52:36.553079+0000","last_fullsized":"2024-05-12T22:52:36.553079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550955+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:52:36.550955+0000","last_peered":"2024-05-12T22:52:36.550955+0000","last_clean":"2024-05-12T22:52:36.550955+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:52:36.550955+0000","last_undegraded":"2024-05-12T22:52:36.550955+0000","last_fullsized":"2024-05-12T22:52:36.550955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806416+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:52:36.806416+0000","last_peered":"2024-05-12T22:52:36.806416+0000","last_clean":"2024-05-12T22:52:36.806416+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:52:36.806416+0000","last_undegraded":"2024-05-12T22:52:36.806416+0000","last_fullsized":"2024-05-12T22:52:36.806416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556220+0000","last_change":"2024-05-12T22:52:35.573997+0000","last_active":"2024-05-12T22:52:36.556220+0000","last_peered":"2024-05-12T22:52:36.556220+0000","last_clean":"2024-05-12T22:52:36.556220+0000","last_became_active":"2024-05-12T22:52:35.573264+0000","last_became_peered":"2024-05-12T22:52:35.573264+0000","last_unstale":"2024-05-12T22:52:36.556220+0000","last_undegraded":"2024-05-12T22:52:36.556220+0000","last_fullsized":"2024-05-12T22:52:36.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556467+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:52:36.556467+0000","last_peered":"2024-05-12T22:52:36.556467+0000","last_clean":"2024-05-12T22:52:36.556467+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:52:36.556467+0000","last_undegraded":"2024-05-12T22:52:36.556467+0000","last_fullsized":"2024-05-12T22:52:36.556467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286491+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:52:37.286491+0000","last_peered":"2024-05-12T22:52:37.286491+0000","last_clean":"2024-05-12T22:52:37.286491+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:52:37.286491+0000","last_undegraded":"2024-05-12T22:52:37.286491+0000","last_fullsized":"2024-05-12T22:52:37.286491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551240+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:52:36.551240+0000","last_peered":"2024-05-12T22:52:36.551240+0000","last_clean":"2024-05-12T22:52:36.551240+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:52:36.551240+0000","last_undegraded":"2024-05-12T22:52:36.551240+0000","last_fullsized":"2024-05-12T22:52:36.551240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554358+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:52:36.554358+0000","last_peered":"2024-05-12T22:52:36.554358+0000","last_clean":"2024-05-12T22:52:36.554358+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:52:36.554358+0000","last_undegraded":"2024-05-12T22:52:36.554358+0000","last_fullsized":"2024-05-12T22:52:36.554358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805922+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:52:36.805922+0000","last_peered":"2024-05-12T22:52:36.805922+0000","last_clean":"2024-05-12T22:52:36.805922+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:52:36.805922+0000","last_undegraded":"2024-05-12T22:52:36.805922+0000","last_fullsized":"2024-05-12T22:52:36.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285389+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:52:37.285389+0000","last_peered":"2024-05-12T22:52:37.285389+0000","last_clean":"2024-05-12T22:52:37.285389+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:52:37.285389+0000","last_undegraded":"2024-05-12T22:52:37.285389+0000","last_fullsized":"2024-05-12T22:52:37.285389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285931+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:52:37.285931+0000","last_peered":"2024-05-12T22:52:37.285931+0000","last_clean":"2024-05-12T22:52:37.285931+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:52:37.285931+0000","last_undegraded":"2024-05-12T22:52:37.285931+0000","last_fullsized":"2024-05-12T22:52:37.285931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285269+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:52:37.285269+0000","last_peered":"2024-05-12T22:52:37.285269+0000","last_clean":"2024-05-12T22:52:37.285269+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:52:37.285269+0000","last_undegraded":"2024-05-12T22:52:37.285269+0000","last_fullsized":"2024-05-12T22:52:37.285269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555310+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:52:36.555310+0000","last_peered":"2024-05-12T22:52:36.555310+0000","last_clean":"2024-05-12T22:52:36.555310+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:52:36.555310+0000","last_undegraded":"2024-05-12T22:52:36.555310+0000","last_fullsized":"2024-05-12T22:52:36.555310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285573+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:52:37.285573+0000","last_peered":"2024-05-12T22:52:37.285573+0000","last_clean":"2024-05-12T22:52:37.285573+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:52:37.285573+0000","last_undegraded":"2024-05-12T22:52:37.285573+0000","last_fullsized":"2024-05-12T22:52:37.285573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805974+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:52:36.805974+0000","last_peered":"2024-05-12T22:52:36.805974+0000","last_clean":"2024-05-12T22:52:36.805974+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:52:36.805974+0000","last_undegraded":"2024-05-12T22:52:36.805974+0000","last_fullsized":"2024-05-12T22:52:36.805974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.805837+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:52:36.805837+0000","last_peered":"2024-05-12T22:52:36.805837+0000","last_clean":"2024-05-12T22:52:36.805837+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:52:36.805837+0000","last_undegraded":"2024-05-12T22:52:36.805837+0000","last_fullsized":"2024-05-12T22:52:36.805837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986661+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:52:36.986661+0000","last_peered":"2024-05-12T22:52:36.986661+0000","last_clean":"2024-05-12T22:52:36.986661+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:52:36.986661+0000","last_undegraded":"2024-05-12T22:52:36.986661+0000","last_fullsized":"2024-05-12T22:52:36.986661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285096+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:52:37.285096+0000","last_peered":"2024-05-12T22:52:37.285096+0000","last_clean":"2024-05-12T22:52:37.285096+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:52:37.285096+0000","last_undegraded":"2024-05-12T22:52:37.285096+0000","last_fullsized":"2024-05-12T22:52:37.285096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554755+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:52:36.554755+0000","last_peered":"2024-05-12T22:52:36.554755+0000","last_clean":"2024-05-12T22:52:36.554755+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:52:36.554755+0000","last_undegraded":"2024-05-12T22:52:36.554755+0000","last_fullsized":"2024-05-12T22:52:36.554755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285734+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:52:37.285734+0000","last_peered":"2024-05-12T22:52:37.285734+0000","last_clean":"2024-05-12T22:52:37.285734+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:52:37.285734+0000","last_undegraded":"2024-05-12T22:52:37.285734+0000","last_fullsized":"2024-05-12T22:52:37.285734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987315+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:52:36.987315+0000","last_peered":"2024-05-12T22:52:36.987315+0000","last_clean":"2024-05-12T22:52:36.987315+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:52:36.987315+0000","last_undegraded":"2024-05-12T22:52:36.987315+0000","last_fullsized":"2024-05-12T22:52:36.987315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286529+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:52:37.286529+0000","last_peered":"2024-05-12T22:52:37.286529+0000","last_clean":"2024-05-12T22:52:37.286529+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:52:37.286529+0000","last_undegraded":"2024-05-12T22:52:37.286529+0000","last_fullsized":"2024-05-12T22:52:37.286529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551350+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:52:36.551350+0000","last_peered":"2024-05-12T22:52:36.551350+0000","last_clean":"2024-05-12T22:52:36.551350+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:52:36.551350+0000","last_undegraded":"2024-05-12T22:52:36.551350+0000","last_fullsized":"2024-05-12T22:52:36.551350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555376+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:52:36.555376+0000","last_peered":"2024-05-12T22:52:36.555376+0000","last_clean":"2024-05-12T22:52:36.555376+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:52:36.555376+0000","last_undegraded":"2024-05-12T22:52:36.555376+0000","last_fullsized":"2024-05-12T22:52:36.555376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.987063+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:52:36.987063+0000","last_peered":"2024-05-12T22:52:36.987063+0000","last_clean":"2024-05-12T22:52:36.987063+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:52:36.987063+0000","last_undegraded":"2024-05-12T22:52:36.987063+0000","last_fullsized":"2024-05-12T22:52:36.987063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285638+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:52:37.285638+0000","last_peered":"2024-05-12T22:52:37.285638+0000","last_clean":"2024-05-12T22:52:37.285638+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:52:37.285638+0000","last_undegraded":"2024-05-12T22:52:37.285638+0000","last_fullsized":"2024-05-12T22:52:37.285638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284734+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:52:37.284734+0000","last_peered":"2024-05-12T22:52:37.284734+0000","last_clean":"2024-05-12T22:52:37.284734+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:52:37.284734+0000","last_undegraded":"2024-05-12T22:52:37.284734+0000","last_fullsized":"2024-05-12T22:52:37.284734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.554095+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:52:36.554095+0000","last_peered":"2024-05-12T22:52:36.554095+0000","last_clean":"2024-05-12T22:52:36.554095+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:52:36.554095+0000","last_undegraded":"2024-05-12T22:52:36.554095+0000","last_fullsized":"2024-05-12T22:52:36.554095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285580+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:52:37.285580+0000","last_peered":"2024-05-12T22:52:37.285580+0000","last_clean":"2024-05-12T22:52:37.285580+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:52:37.285580+0000","last_undegraded":"2024-05-12T22:52:37.285580+0000","last_fullsized":"2024-05-12T22:52:37.285580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284582+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:52:37.284582+0000","last_peered":"2024-05-12T22:52:37.284582+0000","last_clean":"2024-05-12T22:52:37.284582+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:52:37.284582+0000","last_undegraded":"2024-05-12T22:52:37.284582+0000","last_fullsized":"2024-05-12T22:52:37.284582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284790+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:52:37.284790+0000","last_peered":"2024-05-12T22:52:37.284790+0000","last_clean":"2024-05-12T22:52:37.284790+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:52:37.284790+0000","last_undegraded":"2024-05-12T22:52:37.284790+0000","last_fullsized":"2024-05-12T22:52:37.284790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.986949+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:52:36.986949+0000","last_peered":"2024-05-12T22:52:36.986949+0000","last_clean":"2024-05-12T22:52:36.986949+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:52:36.986949+0000","last_undegraded":"2024-05-12T22:52:36.986949+0000","last_fullsized":"2024-05-12T22:52:36.986949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.550923+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:52:36.550923+0000","last_peered":"2024-05-12T22:52:36.550923+0000","last_clean":"2024-05-12T22:52:36.550923+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:52:36.550923+0000","last_undegraded":"2024-05-12T22:52:36.550923+0000","last_fullsized":"2024-05-12T22:52:36.550923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555532+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:52:36.555532+0000","last_peered":"2024-05-12T22:52:36.555532+0000","last_clean":"2024-05-12T22:52:36.555532+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:52:36.555532+0000","last_undegraded":"2024-05-12T22:52:36.555532+0000","last_fullsized":"2024-05-12T22:52:36.555532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.553978+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:52:36.553978+0000","last_peered":"2024-05-12T22:52:36.553978+0000","last_clean":"2024-05-12T22:52:36.553978+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:52:36.553978+0000","last_undegraded":"2024-05-12T22:52:36.553978+0000","last_fullsized":"2024-05-12T22:52:36.553978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551249+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:52:36.551249+0000","last_peered":"2024-05-12T22:52:36.551249+0000","last_clean":"2024-05-12T22:52:36.551249+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:52:36.551249+0000","last_undegraded":"2024-05-12T22:52:36.551249+0000","last_fullsized":"2024-05-12T22:52:36.551249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.556158+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:52:36.556158+0000","last_peered":"2024-05-12T22:52:36.556158+0000","last_clean":"2024-05-12T22:52:36.556158+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:52:36.556158+0000","last_undegraded":"2024-05-12T22:52:36.556158+0000","last_fullsized":"2024-05-12T22:52:36.556158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285916+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:52:37.285916+0000","last_peered":"2024-05-12T22:52:37.285916+0000","last_clean":"2024-05-12T22:52:37.285916+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:52:37.285916+0000","last_undegraded":"2024-05-12T22:52:37.285916+0000","last_fullsized":"2024-05-12T22:52:37.285916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551253+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:52:36.551253+0000","last_peered":"2024-05-12T22:52:36.551253+0000","last_clean":"2024-05-12T22:52:36.551253+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:52:36.551253+0000","last_undegraded":"2024-05-12T22:52:36.551253+0000","last_fullsized":"2024-05-12T22:52:36.551253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551448+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:52:36.551448+0000","last_peered":"2024-05-12T22:52:36.551448+0000","last_clean":"2024-05-12T22:52:36.551448+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:52:36.551448+0000","last_undegraded":"2024-05-12T22:52:36.551448+0000","last_fullsized":"2024-05-12T22:52:36.551448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287370+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:52:37.287370+0000","last_peered":"2024-05-12T22:52:37.287370+0000","last_clean":"2024-05-12T22:52:37.287370+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:52:37.287370+0000","last_undegraded":"2024-05-12T22:52:37.287370+0000","last_fullsized":"2024-05-12T22:52:37.287370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806544+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:52:36.806544+0000","last_peered":"2024-05-12T22:52:36.806544+0000","last_clean":"2024-05-12T22:52:36.806544+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:52:36.806544+0000","last_undegraded":"2024-05-12T22:52:36.806544+0000","last_fullsized":"2024-05-12T22:52:36.806544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.284624+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:52:37.284624+0000","last_peered":"2024-05-12T22:52:37.284624+0000","last_clean":"2024-05-12T22:52:37.284624+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:52:37.284624+0000","last_undegraded":"2024-05-12T22:52:37.284624+0000","last_fullsized":"2024-05-12T22:52:37.284624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.552899+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:52:36.552899+0000","last_peered":"2024-05-12T22:52:36.552899+0000","last_clean":"2024-05-12T22:52:36.552899+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:52:36.552899+0000","last_undegraded":"2024-05-12T22:52:36.552899+0000","last_fullsized":"2024-05-12T22:52:36.552899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551027+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:52:36.551027+0000","last_peered":"2024-05-12T22:52:36.551027+0000","last_clean":"2024-05-12T22:52:36.551027+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:52:36.551027+0000","last_undegraded":"2024-05-12T22:52:36.551027+0000","last_fullsized":"2024-05-12T22:52:36.551027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286426+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:52:37.286426+0000","last_peered":"2024-05-12T22:52:37.286426+0000","last_clean":"2024-05-12T22:52:37.286426+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:52:37.286426+0000","last_undegraded":"2024-05-12T22:52:37.286426+0000","last_fullsized":"2024-05-12T22:52:37.286426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.551214+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:52:36.551214+0000","last_peered":"2024-05-12T22:52:36.551214+0000","last_clean":"2024-05-12T22:52:36.551214+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:52:36.551214+0000","last_undegraded":"2024-05-12T22:52:36.551214+0000","last_fullsized":"2024-05-12T22:52:36.551214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.287516+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:52:37.287516+0000","last_peered":"2024-05-12T22:52:37.287516+0000","last_clean":"2024-05-12T22:52:37.287516+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:52:37.287516+0000","last_undegraded":"2024-05-12T22:52:37.287516+0000","last_fullsized":"2024-05-12T22:52:37.287516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286053+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:52:37.286053+0000","last_peered":"2024-05-12T22:52:37.286053+0000","last_clean":"2024-05-12T22:52:37.286053+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:52:37.286053+0000","last_undegraded":"2024-05-12T22:52:37.286053+0000","last_fullsized":"2024-05-12T22:52:37.286053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.806064+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:52:36.806064+0000","last_peered":"2024-05-12T22:52:36.806064+0000","last_clean":"2024-05-12T22:52:36.806064+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:52:36.806064+0000","last_undegraded":"2024-05-12T22:52:36.806064+0000","last_fullsized":"2024-05-12T22:52:36.806064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555992+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:52:36.555992+0000","last_peered":"2024-05-12T22:52:36.555992+0000","last_clean":"2024-05-12T22:52:36.555992+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:52:36.555992+0000","last_undegraded":"2024-05-12T22:52:36.555992+0000","last_fullsized":"2024-05-12T22:52:36.555992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285271+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:52:37.285271+0000","last_peered":"2024-05-12T22:52:37.285271+0000","last_clean":"2024-05-12T22:52:37.285271+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:52:37.285271+0000","last_undegraded":"2024-05-12T22:52:37.285271+0000","last_fullsized":"2024-05-12T22:52:37.285271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:36.555168+0000","last_change":"2024-05-12T22:52:35.597304+0000","last_active":"2024-05-12T22:52:36.555168+0000","last_peered":"2024-05-12T22:52:36.555168+0000","last_clean":"2024-05-12T22:52:36.555168+0000","last_became_active":"2024-05-12T22:52:35.596833+0000","last_became_peered":"2024-05-12T22:52:35.596833+0000","last_unstale":"2024-05-12T22:52:36.555168+0000","last_undegraded":"2024-05-12T22:52:36.555168+0000","last_fullsized":"2024-05-12T22:52:36.555168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.285683+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:52:37.285683+0000","last_peered":"2024-05-12T22:52:37.285683+0000","last_clean":"2024-05-12T22:52:37.285683+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:52:37.285683+0000","last_undegraded":"2024-05-12T22:52:37.285683+0000","last_fullsized":"2024-05-12T22:52:37.285683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286235+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:52:37.286235+0000","last_peered":"2024-05-12T22:52:37.286235+0000","last_clean":"2024-05-12T22:52:37.286235+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:52:37.286235+0000","last_undegraded":"2024-05-12T22:52:37.286235+0000","last_fullsized":"2024-05-12T22:52:37.286235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286968+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:52:37.286968+0000","last_peered":"2024-05-12T22:52:37.286968+0000","last_clean":"2024-05-12T22:52:37.286968+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:52:37.286968+0000","last_undegraded":"2024-05-12T22:52:37.286968+0000","last_fullsized":"2024-05-12T22:52:37.286968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286666+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:52:37.286666+0000","last_peered":"2024-05-12T22:52:37.286666+0000","last_clean":"2024-05-12T22:52:37.286666+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:52:37.286666+0000","last_undegraded":"2024-05-12T22:52:37.286666+0000","last_fullsized":"2024-05-12T22:52:37.286666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-12T22:52:37.286636+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:52:37.286636+0000","last_peered":"2024-05-12T22:52:37.286636+0000","last_clean":"2024-05-12T22:52:37.286636+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:52:37.286636+0000","last_undegraded":"2024-05-12T22:52:37.286636+0000","last_fullsized":"2024-05-12T22:52:37.286636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":663551,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":72691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":72727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":72601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":663607,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:52:47.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T22:52:47.646 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-12T22:52:47.646 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-12T22:52:47.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-12T22:52:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.803+0000 7f207f8ff640 1 Processor -- start 2024-05-12T22:52:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.803+0000 7f207f8ff640 1 -- start start 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20780b5f80 0x7f20781487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 0x7f207813f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207813f9c0 con 0x7f207813f590 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2078148d30 con 0x7f20780b5f80 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f20780b6360 con 0x7f207806f860 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20780b5f80 0x7f20781487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20780b5f80 0x7f20781487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60392/0 (socket says 172.21.15.40:60392) 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 -- 172.21.15.40:0/3052836141 learned_addr learned my addr 172.21.15.40:0/3052836141 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207ce9a640 1 --2- 172.21.15.40:0/3052836141 >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 0x7f207813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 -- 172.21.15.40:0/3052836141 >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 msgr2=0x7f207813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 --2- 172.21.15.40:0/3052836141 >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 0x7f207813f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 -- 172.21.15.40:0/3052836141 >> v1:172.21.15.47:6789/0 conn(0x7f207813f590 legacy=0x7f20781467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:47.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 -- 172.21.15.40:0/3052836141 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078148f50 con 0x7f20780b5f80 2024-05-12T22:52:47.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207ce9a640 1 --2- 172.21.15.40:0/3052836141 >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 0x7f207813f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207d69b640 1 --2- 172.21.15.40:0/3052836141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781487f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20780afec0 tx=0x7f206801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c624e118299e61 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f206ffff640 1 -- 172.21.15.40:0/3052836141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680b0070 con 0x7f20780b5f80 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f206ffff640 1 -- 172.21.15.40:0/3052836141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20680ab600 con 0x7f20780b5f80 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f206ffff640 1 -- 172.21.15.40:0/3052836141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680ab9d0 con 0x7f20780b5f80 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- 172.21.15.40:0/3052836141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 msgr2=0x7f20781487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 --2- 172.21.15.40:0/3052836141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781487f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20780afec0 tx=0x7f206801c3c0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- 172.21.15.40:0/3052836141 shutdown_connections 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 --2- 172.21.15.40:0/3052836141 >> v2:172.21.15.47:3300/0 conn(0x7f207806f860 0x7f207813f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 --2- 172.21.15.40:0/3052836141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781487f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- 172.21.15.40:0/3052836141 >> 172.21.15.40:0/3052836141 conn(0x7f20780b9300 msgr2=0x7f20780b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.807+0000 7f207f8ff640 1 -- 172.21.15.40:0/3052836141 shutdown_connections 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- 172.21.15.40:0/3052836141 wait complete. 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 Processor -- start 2024-05-12T22:52:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- start start 2024-05-12T22:52:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f207806f860 0x7f2078143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f207813f590 0x7f2078137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2078152730 con 0x7f20780b5f80 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20781525b0 con 0x7f207813f590 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f20781528b0 con 0x7f207806f860 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60408/0 (socket says 172.21.15.40:60408) 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 -- 172.21.15.40:0/897081758 learned_addr learned my addr 172.21.15.40:0/897081758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 -- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f207806f860 msgr2=0x7f2078143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f207806f860 0x7f2078143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 -- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f207813f590 msgr2=0x7f2078137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f207813f590 0x7f2078137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 -- 172.21.15.40:0/897081758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20780712d0 con 0x7f20780b5f80 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207ce9a640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207400c7c0 tx=0x7f207400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074007a30 con 0x7f20780b5f80 2024-05-12T22:52:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2074007bd0 con 0x7f20780b5f80 2024-05-12T22:52:47.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20781ddf30 con 0x7f20780b5f80 2024-05-12T22:52:47.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20740113f0 con 0x7f20780b5f80 2024-05-12T22:52:47.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781de1f0 con 0x7f20780b5f80 2024-05-12T22:52:47.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2078068330 con 0x7f20780b5f80 2024-05-12T22:52:47.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.811+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2074011590 con 0x7f20780b5f80 2024-05-12T22:52:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.815+0000 7f206dffb640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 0x7f205c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.815+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2074085de0 con 0x7f20780b5f80 2024-05-12T22:52:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.815+0000 7f207d69b640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 0x7f205c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.815+0000 7f207d69b640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 0x7f205c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20680ad000 tx=0x7f2068004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:47.819+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2074015020 con 0x7f20780b5f80 2024-05-12T22:52:48.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20780b7120 con 0x7f20780b5f80 2024-05-12T22:52:48.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f206dffb640 1 -- 172.21.15.40:0/897081758 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2074056990 con 0x7f20780b5f80 2024-05-12T22:52:48.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:48.007 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-12T22:52:48.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 msgr2=0x7f205c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 0x7f205c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20680ad000 tx=0x7f2068004740 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 msgr2=0x7f20781de710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207400c7c0 tx=0x7f207400cc80 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 shutdown_connections 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f205c0678c0 0x7f205c069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f207813f590 0x7f2078137d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20780b5f80 0x7f20781de710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 --2- 172.21.15.40:0/897081758 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f207806f860 0x7f2078143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.007+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 >> 172.21.15.40:0/897081758 conn(0x7f20780b9300 msgr2=0x7f207806ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.011+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 shutdown_connections 2024-05-12T22:52:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.011+0000 7f207f8ff640 1 -- 172.21.15.40:0/897081758 wait complete. 2024-05-12T22:52:48.025 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-12T22:52:48.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 Processor -- start 2024-05-12T22:52:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 -- start start 2024-05-12T22:52:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fae7c067070 0x7fae7c13f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 0x7fae7c148860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae7c067450 0x7fae7c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fae7c070450 con 0x7fae7c067450 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fae7c0b3880 con 0x7fae7c067070 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae8182c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fae7c0b5450 con 0x7fae7c073730 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae7c067450 0x7fae7c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae7c067450 0x7fae7c148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60414/0 (socket says 172.21.15.40:60414) 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 -- 172.21.15.40:0/4172883112 learned_addr learned my addr 172.21.15.40:0/4172883112 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7affd640 1 --2- 172.21.15.40:0/4172883112 >> v2:172.21.15.47:3300/0 conn(0x7fae7c067070 0x7fae7c13f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae73fff640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 0x7fae7c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 -- 172.21.15.40:0/4172883112 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 msgr2=0x7fae7c148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 0x7fae7c148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 -- 172.21.15.40:0/4172883112 >> v2:172.21.15.47:3300/0 conn(0x7fae7c067070 msgr2=0x7fae7c13f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/4172883112 >> v2:172.21.15.47:3300/0 conn(0x7fae7c067070 0x7fae7c13f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae7b7fe640 1 -- 172.21.15.40:0/4172883112 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c0b56f0 con 0x7fae7c067450 2024-05-12T22:52:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.143+0000 7fae73fff640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 0x7fae7c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c067450 0x7fae7c148da0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06c790 tx=0x7fae7401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bbc555f2457aa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7a7fc640 1 -- 172.21.15.40:0/4172883112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740a57b0 con 0x7fae7c067450 2024-05-12T22:52:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7a7fc640 1 -- 172.21.15.40:0/4172883112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740a5950 con 0x7fae7c067450 2024-05-12T22:52:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7a7fc640 1 -- 172.21.15.40:0/4172883112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740a5d20 con 0x7fae7c067450 2024-05-12T22:52:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- 172.21.15.40:0/4172883112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c067450 msgr2=0x7fae7c148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c067450 0x7fae7c148da0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06c790 tx=0x7fae7401c930 comp rx=0 tx=0).stop 2024-05-12T22:52:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- 172.21.15.40:0/4172883112 shutdown_connections 2024-05-12T22:52:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c067450 0x7fae7c148da0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- 172.21.15.40:0/4172883112 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c073730 0x7fae7c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- 172.21.15.40:0/4172883112 >> v2:172.21.15.47:3300/0 conn(0x7fae7c067070 0x7fae7c13f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- 172.21.15.40:0/4172883112 >> 172.21.15.40:0/4172883112 conn(0x7fae7c0b62d0 msgr2=0x7fae7c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- 172.21.15.40:0/4172883112 shutdown_connections 2024-05-12T22:52:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- 172.21.15.40:0/4172883112 wait complete. 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 Processor -- start 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- start start 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 0x7fae7c139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c067450 0x7fae7c13a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0b4970 con 0x7fae7c073730 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0b47f0 con 0x7fae7c067070 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae8182c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fae7c0b4af0 con 0x7fae7c067450 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60430/0 (socket says 172.21.15.40:60430) 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 -- 172.21.15.40:0/2202961350 learned_addr learned my addr 172.21.15.40:0/2202961350 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7affd640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 0x7fae7c139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 -- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c067450 msgr2=0x7fae7c13a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c067450 0x7fae7c13a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 -- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 msgr2=0x7fae7c139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 0x7fae7c139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 -- 172.21.15.40:0/2202961350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c13c320 con 0x7fae7c073730 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7affd640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 0x7fae7c139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.147+0000 7fae7b7fe640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae740af040 tx=0x7fae740196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740bc020 con 0x7fae7c073730 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740b8690 con 0x7fae7c073730 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c14eea0 con 0x7fae7c073730 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740b8a80 con 0x7fae7c073730 2024-05-12T22:52:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c138720 con 0x7fae7c073730 2024-05-12T22:52:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7c068a40 con 0x7fae7c073730 2024-05-12T22:52:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae740bf020 con 0x7fae7c073730 2024-05-12T22:52:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 0x7fae5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae74120dc0 con 0x7fae7c073730 2024-05-12T22:52:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae7affd640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 0x7fae5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.151+0000 7fae7affd640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 0x7fae5c069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae7c1dddd0 tx=0x7fae6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.155+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fae740c6030 con 0x7fae7c073730 2024-05-12T22:52:48.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.311+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae7c142c90 con 0x7fae7c073730 2024-05-12T22:52:48.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.315+0000 7fae78ff9640 1 -- 172.21.15.40:0/2202961350 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7fae740165e0 con 0x7fae7c073730 2024-05-12T22:52:48.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:48.316 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:48.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 msgr2=0x7fae5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 0x7fae5c069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae7c1dddd0 tx=0x7fae6c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:48.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 msgr2=0x7fae7c13bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae740af040 tx=0x7fae740196d0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 shutdown_connections 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae7c073730 0x7fae7c13bde0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae7c067450 0x7fae7c13a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae5c0678c0 0x7fae5c069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 --2- 172.21.15.40:0/2202961350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae7c067070 0x7fae7c139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 >> 172.21.15.40:0/2202961350 conn(0x7fae7c0b62d0 msgr2=0x7fae7c06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 shutdown_connections 2024-05-12T22:52:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.319+0000 7fae8182c640 1 -- 172.21.15.40:0/2202961350 wait complete. 2024-05-12T22:52:48.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-12T22:52:33.297648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-12T22:52:33.880238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:52:48.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:52:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.447+0000 7fe0e3c67640 1 Processor -- start 2024-05-12T22:52:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.447+0000 7fe0e3c67640 1 -- start start 2024-05-12T22:52:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e3c67640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e3c67640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 0x7fe0dc148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e3c67640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc149230 con 0x7fe0dc0b5d70 2024-05-12T22:52:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e3c67640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc142c40 con 0x7fe0dc148860 2024-05-12T22:52:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e3c67640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc0b6150 con 0x7fe0dc1422a0 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e2204640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 0x7fe0dc148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:56680/0 (socket says 172.21.15.40:56680) 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1a03640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe0dc0b5d70 0x7fe0dc0b2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47754/0 (socket says 172.21.15.40:47754) 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 -- 172.21.15.40:0/882683729 learned_addr learned my addr 172.21.15.40:0/882683729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 -- 172.21.15.40:0/882683729 >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 msgr2=0x7fe0dc148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 --2- 172.21.15.40:0/882683729 >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 0x7fe0dc148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 -- 172.21.15.40:0/882683729 >> v1:172.21.15.47:6789/0 conn(0x7fe0dc0b5d70 legacy=0x7fe0dc0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 -- 172.21.15.40:0/882683729 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0b4e70 con 0x7fe0dc1422a0 2024-05-12T22:52:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e2204640 1 --2- 172.21.15.40:0/882683729 >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 0x7fe0dc148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.451+0000 7fe0e1202640 1 --2- 172.21.15.40:0/882683729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009870 tx=0x7fe0cc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cadd4efc63676b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e0a01640 1 -- 172.21.15.40:0/882683729 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0b0070 con 0x7fe0dc1422a0 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e0a01640 1 -- 172.21.15.40:0/882683729 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0ab600 con 0x7fe0dc1422a0 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e0a01640 1 -- 172.21.15.40:0/882683729 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0ab9d0 con 0x7fe0dc1422a0 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/882683729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 msgr2=0x7fe0dc142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/882683729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009870 tx=0x7fe0cc01c440 comp rx=0 tx=0).stop 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/882683729 shutdown_connections 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/882683729 >> v2:172.21.15.47:3300/0 conn(0x7fe0dc148860 0x7fe0dc148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/882683729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc142700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/882683729 >> 172.21.15.40:0/882683729 conn(0x7fe0dc06b6c0 msgr2=0x7fe0dc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/882683729 shutdown_connections 2024-05-12T22:52:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/882683729 wait complete. 2024-05-12T22:52:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 Processor -- start 2024-05-12T22:52:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- start start 2024-05-12T22:52:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0dc0b5d70 0x7fe0dc072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc1dd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc152710 con 0x7fe0dc148860 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc152590 con 0x7fe0dc0b5d70 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc152890 con 0x7fe0dc1422a0 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60446/0 (socket says 172.21.15.40:60446) 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 -- 172.21.15.40:0/750031248 learned_addr learned my addr 172.21.15.40:0/750031248 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e1a03640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0dc0b5d70 0x7fe0dc072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e1202640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc1dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 -- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 msgr2=0x7fe0dc1dd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc1dd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 -- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0dc0b5d70 msgr2=0x7fe0dc072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0dc0b5d70 0x7fe0dc072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 -- 172.21.15.40:0/750031248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc13b300 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e2204640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009f00 tx=0x7fe0d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4018030 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d400ce50 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc13b570 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4003bc0 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.455+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc072d80 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc13c1a0 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0d401b070 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0d27fc640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 0x7fe0c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe0d4086650 con 0x7fe0dc148860 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0e1a03640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 0x7fe0c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.459+0000 7fe0e1a03640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 0x7fe0c0069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8000f70 tx=0x7fe0d8007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.463+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe0d4022070 con 0x7fe0dc148860 2024-05-12T22:52:48.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.619+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe0dc068330 con 0x7fe0dc148860 2024-05-12T22:52:48.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.619+0000 7fe0d27fc640 1 -- 172.21.15.40:0/750031248 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fe0d4010040 con 0x7fe0dc148860 2024-05-12T22:52:48.620 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 msgr2=0x7fe0c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 0x7fe0c0069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8000f70 tx=0x7fe0d8007cf0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 msgr2=0x7fe0dc1e0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009f00 tx=0x7fe0d400c490 comp rx=0 tx=0).stop 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 shutdown_connections 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc148860 0x7fe0dc1e0df0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0dc1422a0 0x7fe0dc1dd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe0c00678c0 0x7fe0c0069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 --2- 172.21.15.40:0/750031248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0dc0b5d70 0x7fe0dc072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 >> 172.21.15.40:0/750031248 conn(0x7fe0dc06b6c0 msgr2=0x7fe0dc1432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 shutdown_connections 2024-05-12T22:52:48.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.623+0000 7fe0e3c67640 1 -- 172.21.15.40:0/750031248 wait complete. 2024-05-12T22:52:48.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-12T22:52:48.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 Processor -- start 2024-05-12T22:52:48.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 -- start start 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5144147730 0x7f5144147da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5144141800 0x7f514414b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5144147b10 con 0x7f5144141380 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5144141c50 con 0x7f5144147730 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514b79f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f51440b6d10 con 0x7f5144141800 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5144147730 0x7f5144147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5144147730 0x7f5144147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60452/0 (socket says 172.21.15.40:60452) 2024-05-12T22:52:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 -- 172.21.15.40:0/3348307808 learned_addr learned my addr 172.21.15.40:0/3348307808 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f5149d3c640 1 --2- 172.21.15.40:0/3348307808 >> v2:172.21.15.47:3300/0 conn(0x7f5144141800 0x7f514414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 -- 172.21.15.40:0/3348307808 >> v2:172.21.15.47:3300/0 conn(0x7f5144141800 msgr2=0x7f514414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 --2- 172.21.15.40:0/3348307808 >> v2:172.21.15.47:3300/0 conn(0x7f5144141800 0x7f514414b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 -- 172.21.15.40:0/3348307808 >> v1:172.21.15.47:6789/0 conn(0x7f5144141380 legacy=0x7f514414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 -- 172.21.15.40:0/3348307808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51440b4660 con 0x7f5144147730 2024-05-12T22:52:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f514953b640 1 --2- 172.21.15.40:0/3348307808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144147730 0x7f5144147da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5144147460 tx=0x7f514001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1232d54345fd92b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f513bfff640 1 -- 172.21.15.40:0/3348307808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400b0070 con 0x7f5144147730 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f513bfff640 1 -- 172.21.15.40:0/3348307808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400ab600 con 0x7f5144147730 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.767+0000 7f513bfff640 1 -- 172.21.15.40:0/3348307808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400ab9d0 con 0x7f5144147730 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/3348307808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144147730 msgr2=0x7f5144147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- 172.21.15.40:0/3348307808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144147730 0x7f5144147da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5144147460 tx=0x7f514001c3c0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/3348307808 shutdown_connections 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- 172.21.15.40:0/3348307808 >> v2:172.21.15.47:3300/0 conn(0x7f5144141800 0x7f514414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- 172.21.15.40:0/3348307808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144147730 0x7f5144147da0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/3348307808 >> 172.21.15.40:0/3348307808 conn(0x7f51440bce70 msgr2=0x7f51440bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/3348307808 shutdown_connections 2024-05-12T22:52:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/3348307808 wait complete. 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 Processor -- start 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- start start 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5144141380 0x7f514413a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5144147730 0x7f514414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51440b9520 con 0x7f5144141800 2024-05-12T22:52:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51440b4f50 con 0x7f5144141380 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f51441482e0 con 0x7f5144147730 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60460/0 (socket says 172.21.15.40:60460) 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 -- 172.21.15.40:0/1729088312 learned_addr learned my addr 172.21.15.40:0/1729088312 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 -- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5144147730 msgr2=0x7f514414a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5144147730 0x7f514414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 -- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5144141380 msgr2=0x7f514413a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5144141380 0x7f514413a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 -- 172.21.15.40:0/1729088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5144141f70 con 0x7f5144141800 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5148d3a640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f513400c450 tx=0x7f513400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134012830 con 0x7f5144141800 2024-05-12T22:52:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134017070 con 0x7f5144141800 2024-05-12T22:52:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5144142250 con 0x7f5144141800 2024-05-12T22:52:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134012c30 con 0x7f5144141800 2024-05-12T22:52:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5144149b60 con 0x7f5144141800 2024-05-12T22:52:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.771+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5144068330 con 0x7f5144141800 2024-05-12T22:52:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.775+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f513401c460 con 0x7f5144141800 2024-05-12T22:52:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.775+0000 7f5139ffb640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 0x7f5128069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.775+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5134085b30 con 0x7f5144141800 2024-05-12T22:52:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.775+0000 7f514953b640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 0x7f5128069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.775+0000 7f514953b640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 0x7f5128069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51400ad000 tx=0x7f5140008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.779+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f51340565d0 con 0x7f5144141800 2024-05-12T22:52:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5144145500 con 0x7f5144141800 2024-05-12T22:52:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f5139ffb640 1 -- 172.21.15.40:0/1729088312 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f5134055ed0 con 0x7f5144141800 2024-05-12T22:52:48.939 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 msgr2=0x7f5128069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 0x7f5128069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51400ad000 tx=0x7f5140008040 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 msgr2=0x7f5144144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f513400c450 tx=0x7f513400c910 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 shutdown_connections 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5144147730 0x7f514414a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5144141800 0x7f5144144480 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f51280678f0 0x7f5128069db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 --2- 172.21.15.40:0/1729088312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5144141380 0x7f514413a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 >> 172.21.15.40:0/1729088312 conn(0x7f51440bce70 msgr2=0x7f51440b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 shutdown_connections 2024-05-12T22:52:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:48.939+0000 7f514b79f640 1 -- 172.21.15.40:0/1729088312 wait complete. 2024-05-12T22:52:48.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-12T22:52:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 Processor -- start 2024-05-12T22:52:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 -- start start 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 0x7f2738072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2738141990 0x7f27380b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2738071c00 con 0x7f27380b53d0 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f27380b0b10 con 0x7f2738141990 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f273d3e8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f27380b5810 con 0x7f27380b6a20 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f27377fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2738141990 0x7f27380b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2736ffd640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 0x7f2738072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f27367fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f27380b53d0 0x7f2738141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47776/0 (socket says 172.21.15.40:47776) 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f27367fc640 1 -- 172.21.15.40:0/3558420337 learned_addr learned my addr 172.21.15.40:0/3558420337 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2735ffb640 1 -- 172.21.15.40:0/3558420337 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080468369 0 0) 0x7f2738071c00 con 0x7f27380b53d0 2024-05-12T22:52:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2735ffb640 1 -- 172.21.15.40:0/3558420337 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2720003530 con 0x7f27380b53d0 2024-05-12T22:52:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2736ffd640 1 -- 172.21.15.40:0/3558420337 >> v2:172.21.15.47:3300/0 conn(0x7f2738141990 msgr2=0x7f27380b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2736ffd640 1 --2- 172.21.15.40:0/3558420337 >> v2:172.21.15.47:3300/0 conn(0x7f2738141990 0x7f27380b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2736ffd640 1 -- 172.21.15.40:0/3558420337 >> v1:172.21.15.47:6789/0 conn(0x7f27380b53d0 legacy=0x7f2738141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.083+0000 7f2736ffd640 1 -- 172.21.15.40:0/3558420337 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27380b6e00 con 0x7f27380b6a20 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f2736ffd640 1 --2- 172.21.15.40:0/3558420337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 0x7f2738072020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2728009d90 tx=0x7f272801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3400e7a57f04817 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f2735ffb640 1 -- 172.21.15.40:0/3558420337 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280b2070 con 0x7f27380b6a20 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f2735ffb640 1 -- 172.21.15.40:0/3558420337 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27280a5830 con 0x7f27380b6a20 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f2735ffb640 1 -- 172.21.15.40:0/3558420337 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5be0 con 0x7f27380b6a20 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- 172.21.15.40:0/3558420337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 msgr2=0x7f2738072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- 172.21.15.40:0/3558420337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 0x7f2738072020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2728009d90 tx=0x7f272801c970 comp rx=0 tx=0).stop 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- 172.21.15.40:0/3558420337 shutdown_connections 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- 172.21.15.40:0/3558420337 >> v2:172.21.15.47:3300/0 conn(0x7f2738141990 0x7f27380b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- 172.21.15.40:0/3558420337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b6a20 0x7f2738072020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- 172.21.15.40:0/3558420337 >> 172.21.15.40:0/3558420337 conn(0x7f273806c3d0 msgr2=0x7f273806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- 172.21.15.40:0/3558420337 shutdown_connections 2024-05-12T22:52:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- 172.21.15.40:0/3558420337 wait complete. 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 Processor -- start 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- start start 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b53d0 0x7f273813bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 0x7f27381e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f27381547b0 con 0x7f27380b6a20 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2738154630 con 0x7f2738141990 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f273d3e8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2738154930 con 0x7f27380b53d0 2024-05-12T22:52:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f27367fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f27367fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60466/0 (socket says 172.21.15.40:60466) 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.087+0000 7f27367fc640 1 -- 172.21.15.40:0/331911996 learned_addr learned my addr 172.21.15.40:0/331911996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27377fe640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 0x7f27381e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f2736ffd640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b53d0 0x7f273813bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 -- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b53d0 msgr2=0x7f273813bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b53d0 0x7f273813bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 -- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 msgr2=0x7f27381e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 0x7f27381e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 -- 172.21.15.40:0/331911996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738142880 con 0x7f27380b6a20 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27377fe640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 0x7f27381e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f27367fc640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272c00c450 tx=0x7f272c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c017070 con 0x7f27380b6a20 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c005cf0 con 0x7f27380b6a20 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c0072f0 con 0x7f27380b6a20 2024-05-12T22:52:49.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2738142080 con 0x7f27380b6a20 2024-05-12T22:52:49.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2738143920 con 0x7f27380b6a20 2024-05-12T22:52:49.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2738068a40 con 0x7f27380b6a20 2024-05-12T22:52:49.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f272c01a070 con 0x7f27380b6a20 2024-05-12T22:52:49.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 0x7f2724069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f2736ffd640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 0x7f2724069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f272c0850a0 con 0x7f27380b6a20 2024-05-12T22:52:49.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.091+0000 7f2736ffd640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 0x7f2724069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27280af000 tx=0x7f27280a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.095+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f272c055c70 con 0x7f27380b6a20 2024-05-12T22:52:49.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.255+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f27380718b0 con 0x7f27380b6a20 2024-05-12T22:52:49.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.255+0000 7f271f7fe640 1 -- 172.21.15.40:0/331911996 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f272c055570 con 0x7f27380b6a20 2024-05-12T22:52:49.258 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-05-12T22:52:49.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 msgr2=0x7f2724069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 0x7f2724069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27280af000 tx=0x7f27280a7070 comp rx=0 tx=0).stop 2024-05-12T22:52:49.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 msgr2=0x7f27381dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272c00c450 tx=0x7f272c00c910 comp rx=0 tx=0).stop 2024-05-12T22:52:49.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 shutdown_connections 2024-05-12T22:52:49.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f27240678c0 0x7f2724069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2738141990 0x7f27381e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27380b6a20 0x7f27381dfc80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 --2- 172.21.15.40:0/331911996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f27380b53d0 0x7f273813bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 >> 172.21.15.40:0/331911996 conn(0x7f273806c3d0 msgr2=0x7f2738145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 shutdown_connections 2024-05-12T22:52:49.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.259+0000 7f273d3e8640 1 -- 172.21.15.40:0/331911996 wait complete. 2024-05-12T22:52:49.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:49.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 Processor -- start 2024-05-12T22:52:49.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 -- start start 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a1c0af9f0 0x7f1a1c143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1a1c144390 0x7f1a1c14e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a1c0b1610 con 0x7f1a1c0b1b20 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c0b0e00 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a225f1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c0b0320 con 0x7f1a1c144390 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a1bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1a1c0b1b20 0x7f1a1c0b3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51754/0 (socket says 172.21.15.40:51754) 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a1bfff640 1 -- 172.21.15.40:0/1982071185 learned_addr learned my addr 172.21.15.40:0/1982071185 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.395+0000 7f1a1b7fe640 1 --2- 172.21.15.40:0/1982071185 >> v2:172.21.15.40:3300/0 conn(0x7f1a1c0af9f0 0x7f1a1c143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a20b8e640 1 --2- 172.21.15.40:0/1982071185 >> v2:172.21.15.47:3300/0 conn(0x7f1a1c144390 0x7f1a1c14e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1affd640 1 -- 172.21.15.40:0/1982071185 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319536402 0 0) 0x7f1a1c0b1610 con 0x7f1a1c0b1b20 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1affd640 1 -- 172.21.15.40:0/1982071185 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a08003530 con 0x7f1a1c0b1b20 2024-05-12T22:52:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1b7fe640 1 -- 172.21.15.40:0/1982071185 >> v2:172.21.15.47:3300/0 conn(0x7f1a1c144390 msgr2=0x7f1a1c14e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1b7fe640 1 --2- 172.21.15.40:0/1982071185 >> v2:172.21.15.47:3300/0 conn(0x7f1a1c144390 0x7f1a1c14e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1b7fe640 1 -- 172.21.15.40:0/1982071185 >> v1:172.21.15.40:6789/0 conn(0x7f1a1c0b1b20 legacy=0x7f1a1c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1b7fe640 1 -- 172.21.15.40:0/1982071185 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c0b0600 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1b7fe640 1 --2- 172.21.15.40:0/1982071185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c0af9f0 0x7f1a1c143e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c073190 tx=0x7f1a0401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3079583c1b6db0d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1affd640 1 -- 172.21.15.40:0/1982071185 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040a66f0 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1affd640 1 -- 172.21.15.40:0/1982071185 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a040a6890 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a1affd640 1 -- 172.21.15.40:0/1982071185 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040a6c60 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 -- 172.21.15.40:0/1982071185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c0af9f0 msgr2=0x7f1a1c143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1982071185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c0af9f0 0x7f1a1c143e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c073190 tx=0x7f1a0401c8a0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 -- 172.21.15.40:0/1982071185 shutdown_connections 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1982071185 >> v2:172.21.15.47:3300/0 conn(0x7f1a1c144390 0x7f1a1c14e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1982071185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c0af9f0 0x7f1a1c143e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 -- 172.21.15.40:0/1982071185 >> 172.21.15.40:0/1982071185 conn(0x7f1a1c06b6c0 msgr2=0x7f1a1c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 -- 172.21.15.40:0/1982071185 shutdown_connections 2024-05-12T22:52:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.399+0000 7f1a225f1640 1 -- 172.21.15.40:0/1982071185 wait complete. 2024-05-12T22:52:49.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 Processor -- start 2024-05-12T22:52:49.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- start start 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a1c0af9f0 0x7f1a1c0b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a1c0b1b20 0x7f1a1c0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c1447a0 con 0x7f1a1c144390 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c0b3d20 con 0x7f1a1c0b1b20 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c144920 con 0x7f1a1c0af9f0 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60484/0 (socket says 172.21.15.40:60484) 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 -- 172.21.15.40:0/1764768516 learned_addr learned my addr 172.21.15.40:0/1764768516 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a1bfff640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a1c0af9f0 0x7f1a1c0b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a1b7fe640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a1c0b1b20 0x7f1a1c0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 -- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a1c0af9f0 msgr2=0x7f1a1c0b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a1c0af9f0 0x7f1a1c0b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 -- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a1c0b1b20 msgr2=0x7f1a1c0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a1c0b1b20 0x7f1a1c0b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 -- 172.21.15.40:0/1764768516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c1310a0 con 0x7f1a1c144390 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a20b8e640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400d600 tx=0x7f1a1400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14015070 con 0x7f1a1c144390 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a14011890 con 0x7f1a1c144390 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c0b7fe0 con 0x7f1a1c144390 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400b040 con 0x7f1a1c144390 2024-05-12T22:52:49.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c0b7c40 con 0x7f1a1c144390 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1c068330 con 0x7f1a1c144390 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a14018070 con 0x7f1a1c144390 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 0x7f19fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a14085ce0 con 0x7f1a1c144390 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.403+0000 7f1a1bfff640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 0x7f19fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.407+0000 7f1a1bfff640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 0x7f19fc069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005890 tx=0x7f1a0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.407+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1a14056810 con 0x7f1a1c144390 2024-05-12T22:52:49.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.603+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a1c1440d0 con 0x7f1a1c144390 2024-05-12T22:52:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.607+0000 7f1a18ff9640 1 -- 172.21.15.40:0/1764768516 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7f1a14056110 con 0x7f1a1c144390 2024-05-12T22:52:49.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:49.608 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:52:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:52:49.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 msgr2=0x7f19fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 0x7f19fc069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005890 tx=0x7f1a0c009040 comp rx=0 tx=0).stop 2024-05-12T22:52:49.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 msgr2=0x7f1a1c0b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400d600 tx=0x7f1a1400dac0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 shutdown_connections 2024-05-12T22:52:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c144390 0x7f1a1c0b6a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f19fc0678c0 0x7f19fc069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a1c0b1b20 0x7f1a1c0b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 --2- 172.21.15.40:0/1764768516 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a1c0af9f0 0x7f1a1c0b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 >> 172.21.15.40:0/1764768516 conn(0x7f1a1c06b6c0 msgr2=0x7f1a1c0b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 shutdown_connections 2024-05-12T22:52:49.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.611+0000 7f1a225f1640 1 -- 172.21.15.40:0/1764768516 wait complete. 2024-05-12T22:52:49.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:49.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.747+0000 7f312cde1640 1 Processor -- start 2024-05-12T22:52:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.747+0000 7f312cde1640 1 -- start start 2024-05-12T22:52:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312cde1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31280bd7a0 0x7f312814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312cde1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31280bdb80 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312cde1640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31280b4550 con 0x7f31280b5cc0 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312cde1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f31280b4e80 con 0x7f31280bd7a0 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3126d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31280b9490 0x7f3128151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34510/0 (socket says 172.21.15.40:34510) 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3126d9d640 1 -- 172.21.15.40:0/3383968315 learned_addr learned my addr 172.21.15.40:0/3383968315 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312659c640 1 --2- 172.21.15.40:0/3383968315 >> v2:172.21.15.47:3300/0 conn(0x7f31280bd7a0 0x7f312814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894650432 0 0) 0x7f31280bdb80 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3110003530 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3912028889 0 0) 0x7f3110003530 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 >> v2:172.21.15.47:3300/0 conn(0x7f31280bd7a0 msgr2=0x7f312814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 --2- 172.21.15.40:0/3383968315 >> v2:172.21.15.47:3300/0 conn(0x7f31280bd7a0 0x7f312814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 >> v1:172.21.15.47:6789/0 conn(0x7f31280b5cc0 legacy=0x7f3128141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31280b4830 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f3120001680 con 0x7f31280b9490 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 >> v1:172.21.15.40:6789/0 conn(0x7f31280b9490 legacy=0x7f3128151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31100039c0 0x7f3110003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 0x7f3110004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31100053d0 0x7f311000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f31280b4e80 con 0x7f3110004810 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f311000c260 con 0x7f31100039c0 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f311000c460 con 0x7f31100053d0 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 0x7f3110004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f312659c640 1 --2- 172.21.15.40:0/3383968315 >> v2:172.21.15.47:3300/0 conn(0x7f31280bd7a0 0x7f312814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3126d9d640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31100053d0 0x7f311000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 -- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31100053d0 msgr2=0x7f311000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31100053d0 0x7f311000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 -- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31100039c0 msgr2=0x7f3110003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31100039c0 0x7f3110003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3125d9b640 1 -- 172.21.15.40:0/3383968315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3110003530 con 0x7f3110004810 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3126d9d640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f31100053d0 0x7f311000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.751+0000 7f3126d9d640 1 -- 172.21.15.40:0/3383968315 reap_dead start 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3125d9b640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 0x7f3110004c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f311c001780 tx=0x7f311c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568017110cd5bd3d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c0013a0 con 0x7f3110004810 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311c0052f0 con 0x7f3110004810 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312559a640 1 -- 172.21.15.40:0/3383968315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c003840 con 0x7f3110004810 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 msgr2=0x7f3110004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 0x7f3110004c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f311c001780 tx=0x7f311c01c400 comp rx=0 tx=0).stop 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/3383968315 shutdown_connections 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 --2- 172.21.15.40:0/3383968315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3110004810 0x7f3110004c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/3383968315 >> 172.21.15.40:0/3383968315 conn(0x7f3128072ff0 msgr2=0x7f31280bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/3383968315 shutdown_connections 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/3383968315 wait complete. 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 Processor -- start 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- start start 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 0x7f3128144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f312813af90 0x7f31281492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f31280b77b0 con 0x7f3128137ba0 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3128141c60 con 0x7f3110004810 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f31280b7930 con 0x7f312813af90 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49458/0 (socket says 172.21.15.40:49458) 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 -- 172.21.15.40:0/1463198033 learned_addr learned my addr 172.21.15.40:0/1463198033 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3125d9b640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f312813af90 0x7f31281492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312659c640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 0x7f3128144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 -- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f312813af90 msgr2=0x7f31281492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f312813af90 0x7f31281492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 -- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 msgr2=0x7f3128144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 0x7f3128144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 -- 172.21.15.40:0/1463198033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3128144d30 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312659c640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 0x7f3128144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3126d9d640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31280b6530 tx=0x7f312000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120007440 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200075e0 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3128138900 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120004a30 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.755+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3128143de0 con 0x7f3128137ba0 2024-05-12T22:52:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31280b9020 con 0x7f3128137ba0 2024-05-12T22:52:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3120004bd0 con 0x7f3128137ba0 2024-05-12T22:52:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f3116ffd640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 0x7f3108069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f31200851a0 con 0x7f3128137ba0 2024-05-12T22:52:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f312659c640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 0x7f3108069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.759+0000 7f312659c640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 0x7f3108069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31180070b0 tx=0x7f311800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:49.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.763+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3120055d70 con 0x7f3128137ba0 2024-05-12T22:52:49.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.927+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3128068330 con 0x7f3128137ba0 2024-05-12T22:52:49.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.927+0000 7f3116ffd640 1 -- 172.21.15.40:0/1463198033 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7f3120055670 con 0x7f3128137ba0 2024-05-12T22:52:49.929 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:49.929 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:49.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 msgr2=0x7f3108069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 0x7f3108069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31180070b0 tx=0x7f311800b040 comp rx=0 tx=0).stop 2024-05-12T22:52:49.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 msgr2=0x7f3128138050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:49.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31280b6530 tx=0x7f312000d900 comp rx=0 tx=0).stop 2024-05-12T22:52:49.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 shutdown_connections 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3128137ba0 0x7f3128138050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f312813af90 0x7f31281492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f31080678f0 0x7f3108069db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 --2- 172.21.15.40:0/1463198033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3110004810 0x7f3128144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 >> 172.21.15.40:0/1463198033 conn(0x7f3128072ff0 msgr2=0x7f312813fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 shutdown_connections 2024-05-12T22:52:49.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:49.931+0000 7f312cde1640 1 -- 172.21.15.40:0/1463198033 wait complete. 2024-05-12T22:52:49.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-12T22:52:33.297648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-12T22:52:33.880238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:52:49.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 Processor -- start 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 -- start start 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af40b7470 con 0x7f9af40b7090 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9af40717d0 con 0x7f9af413e510 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.071+0000 7f9afa694640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9af4070870 con 0x7f9af4070f80 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af8c31640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af8c31640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:35124/0 (socket says 172.21.15.40:35124) 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af8c31640 1 -- 172.21.15.40:0/3876410436 learned_addr learned my addr 172.21.15.40:0/3876410436 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:34800/0 (socket says 172.21.15.40:34800) 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 -- 172.21.15.40:0/3876410436 >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 msgr2=0x7f9af414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 --2- 172.21.15.40:0/3876410436 >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 -- 172.21.15.40:0/3876410436 >> v1:172.21.15.47:6789/0 conn(0x7f9af40b7090 legacy=0x7f9af4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 -- 172.21.15.40:0/3876410436 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af413e960 con 0x7f9af4070f80 2024-05-12T22:52:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af8c31640 1 --2- 172.21.15.40:0/3876410436 >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.075+0000 7f9af37fe640 1 --2- 172.21.15.40:0/3876410436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9af4071950 tx=0x7f9ae401e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d1ac894fe9a709 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af2ffd640 1 -- 172.21.15.40:0/3876410436 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40b3070 con 0x7f9af4070f80 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af2ffd640 1 -- 172.21.15.40:0/3876410436 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae40ae620 con 0x7f9af4070f80 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af2ffd640 1 -- 172.21.15.40:0/3876410436 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40ae9f0 con 0x7f9af4070f80 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/3876410436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 msgr2=0x7f9af413dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- 172.21.15.40:0/3876410436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9af4071950 tx=0x7f9ae401e6b0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/3876410436 shutdown_connections 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- 172.21.15.40:0/3876410436 >> v2:172.21.15.47:3300/0 conn(0x7f9af413e510 0x7f9af414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- 172.21.15.40:0/3876410436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af4070f80 0x7f9af413dfd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/3876410436 >> 172.21.15.40:0/3876410436 conn(0x7f9af40ba250 msgr2=0x7f9af40b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/3876410436 shutdown_connections 2024-05-12T22:52:50.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/3876410436 wait complete. 2024-05-12T22:52:50.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 Processor -- start 2024-05-12T22:52:50.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- start start 2024-05-12T22:52:50.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af40b7090 0x7f9af4143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af413e510 0x7f9af41df810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406bc50 con 0x7f9af4070f80 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406bad0 con 0x7f9af40b7090 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406bdd0 con 0x7f9af413e510 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49460/0 (socket says 172.21.15.40:49460) 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 -- 172.21.15.40:0/878592807 learned_addr learned my addr 172.21.15.40:0/878592807 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af37fe640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af40b7090 0x7f9af4143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af8c31640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af413e510 0x7f9af41df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 -- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af413e510 msgr2=0x7f9af41df810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af413e510 0x7f9af41df810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 -- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af40b7090 msgr2=0x7f9af4143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af40b7090 0x7f9af4143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 -- 172.21.15.40:0/878592807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41468b0 con 0x7f9af4070f80 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af3fff640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c450 tx=0x7f9adc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc016020 con 0x7f9af4070f80 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc0052d0 con 0x7f9af4070f80 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af4147dd0 con 0x7f9af4070f80 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc007260 con 0x7f9af4070f80 2024-05-12T22:52:50.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.079+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4147460 con 0x7f9af4070f80 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4068a40 con 0x7f9af4070f80 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9adc007400 con 0x7f9af4070f80 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9af0ff9640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 0x7f9ad4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9adc0855d0 con 0x7f9af4070f80 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9af37fe640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 0x7f9ad4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.083+0000 7f9af37fe640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 0x7f9ad4069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40b0000 tx=0x7f9ae4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.087+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9adc020020 con 0x7f9af4070f80 2024-05-12T22:52:50.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.247+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9af4146c50 con 0x7f9af4070f80 2024-05-12T22:52:50.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.247+0000 7f9af0ff9640 1 -- 172.21.15.40:0/878592807 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f9adc005480 con 0x7f9af4070f80 2024-05-12T22:52:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 msgr2=0x7f9ad4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 0x7f9ad4069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40b0000 tx=0x7f9ae4008040 comp rx=0 tx=0).stop 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 msgr2=0x7f9af4147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c450 tx=0x7f9adc00c910 comp rx=0 tx=0).stop 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 shutdown_connections 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9af413e510 0x7f9af41df810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9ad40678c0 0x7f9ad4069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af40b7090 0x7f9af4143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 --2- 172.21.15.40:0/878592807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4070f80 0x7f9af4147790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 >> 172.21.15.40:0/878592807 conn(0x7f9af40ba250 msgr2=0x7f9af40b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 shutdown_connections 2024-05-12T22:52:50.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.251+0000 7f9afa694640 1 -- 172.21.15.40:0/878592807 wait complete. 2024-05-12T22:52:50.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-12T22:52:50.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 Processor -- start 2024-05-12T22:52:50.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 -- start start 2024-05-12T22:52:50.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f44144200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f44072a40 con 0x7f8f4413e040 2024-05-12T22:52:50.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4406da20 con 0x7f8f440b4900 2024-05-12T22:52:50.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f48bc2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44072cb0 con 0x7f8f4406d640 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8f4413e040 0x7f8f4413e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34516/0 (socket says 172.21.15.40:34516) 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 -- 172.21.15.40:0/3388091011 learned_addr learned my addr 172.21.15.40:0/3388091011 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4259c640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f44144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7589896 0 0) 0x7f8f44072a40 con 0x7f8f4413e040 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f30003530 con 0x7f8f4413e040 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2455354413 0 0) 0x7f8f30003530 con 0x7f8f4413e040 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 msgr2=0x7f8f44144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f44144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 >> v1:172.21.15.47:6789/0 conn(0x7f8f440b4900 legacy=0x7f8f440b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44144b60 con 0x7f8f4413e040 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f8f3c001680 con 0x7f8f4413e040 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 >> v1:172.21.15.40:6789/0 conn(0x7f8f4413e040 legacy=0x7f8f4413e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f300039f0 0x7f8f30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44072cb0 con 0x7f8f30004d50 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3000dd10 con 0x7f8f300039f0 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3000df10 con 0x7f8f4406d640 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4259c640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f300039f0 0x7f8f30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f41d9b640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 -- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 msgr2=0x7f8f30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f4406d640 0x7f8f30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 -- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f300039f0 msgr2=0x7f8f30003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f300039f0 0x7f8f30003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f42d9d640 1 -- 172.21.15.40:0/3388091011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f30003530 con 0x7f8f30004d50 2024-05-12T22:52:50.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.391+0000 7f8f4259c640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f300039f0 0x7f8f30003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f300051d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c210 tx=0x7f8f3c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34698e00aa2e06b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007d40 con 0x7f8f30004d50 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c005b00 con 0x7f8f30004d50 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f4159a640 1 -- 172.21.15.40:0/3388091011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007070 con 0x7f8f30004d50 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- 172.21.15.40:0/3388091011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 msgr2=0x7f8f300051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/3388091011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f300051d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c210 tx=0x7f8f3c01f3f0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f42d9d640 1 -- 172.21.15.40:0/3388091011 reap_dead start 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- 172.21.15.40:0/3388091011 shutdown_connections 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- 172.21.15.40:0/3388091011 >> 172.21.15.40:0/3388091011 conn(0x7f8f440b6720 msgr2=0x7f8f440b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- 172.21.15.40:0/3388091011 shutdown_connections 2024-05-12T22:52:50.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- 172.21.15.40:0/3388091011 wait complete. 2024-05-12T22:52:50.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 Processor -- start 2024-05-12T22:52:50.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- start start 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f441cb8b0 0x7f8f4413ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 0x7f8f441dba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44144200 con 0x7f8f30004d50 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44145120 con 0x7f8f441cb8b0 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.395+0000 7f8f48bc2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44144380 con 0x7f8f441ca810 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49476/0 (socket says 172.21.15.40:49476) 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 -- 172.21.15.40:0/4086802497 learned_addr learned my addr 172.21.15.40:0/4086802497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 0x7f8f441dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f41d9b640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f441cb8b0 0x7f8f4413ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 -- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 msgr2=0x7f8f441dba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 0x7f8f441dba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 -- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f441cb8b0 msgr2=0x7f8f4413ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f441cb8b0 0x7f8f4413ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 -- 172.21.15.40:0/4086802497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f441cbde0 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f42d9d640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 0x7f8f441dba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f4259c640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009fc0 tx=0x7f8f34010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401a030 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34010e80 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f441cc0c0 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34003bc0 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f441413e0 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f44068a40 con 0x7f8f30004d50 2024-05-12T22:52:50.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f3401d070 con 0x7f8f30004d50 2024-05-12T22:52:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 0x7f8f24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f41d9b640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 0x7f8f24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f34086aa0 con 0x7f8f30004d50 2024-05-12T22:52:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.399+0000 7f8f41d9b640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 0x7f8f24069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f441dcb30 tx=0x7f8f2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.403+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8f34024070 con 0x7f8f30004d50 2024-05-12T22:52:50.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.567+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8f440678d0 con 0x7f8f30004d50 2024-05-12T22:52:50.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.567+0000 7f8f3affd640 1 -- 172.21.15.40:0/4086802497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f8f3401de40 con 0x7f8f30004d50 2024-05-12T22:52:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 msgr2=0x7f8f24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 0x7f8f24069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f441dcb30 tx=0x7f8f2c009040 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 msgr2=0x7f8f44141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009fc0 tx=0x7f8f34010650 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 shutdown_connections 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8f441ca810 0x7f8f441dba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8f240678c0 0x7f8f24069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f441cb8b0 0x7f8f4413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 --2- 172.21.15.40:0/4086802497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f30004d50 0x7f8f44141be0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 >> 172.21.15.40:0/4086802497 conn(0x7f8f440b6720 msgr2=0x7f8f44074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 shutdown_connections 2024-05-12T22:52:50.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.571+0000 7f8f48bc2640 1 -- 172.21.15.40:0/4086802497 wait complete. 2024-05-12T22:52:50.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-12T22:52:50.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 Processor -- start 2024-05-12T22:52:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 -- start start 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a601422a0 0x7f5a60142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5a60148860 0x7f5a60148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a601491f0 con 0x7f5a600b5d70 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5a60142c70 con 0x7f5a601422a0 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a651c8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5a600b6150 con 0x7f5a60148860 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a601422a0 0x7f5a60142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5a600b5d70 0x7f5a600b2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34532/0 (socket says 172.21.15.40:34532) 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5ed9d640 1 -- 172.21.15.40:0/890014342 learned_addr learned my addr 172.21.15.40:0/890014342 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5f59e640 1 --2- 172.21.15.40:0/890014342 >> v2:172.21.15.47:3300/0 conn(0x7f5a60148860 0x7f5a60148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5dd9b640 1 -- 172.21.15.40:0/890014342 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471245543 0 0) 0x7f5a601491f0 con 0x7f5a600b5d70 2024-05-12T22:52:50.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5dd9b640 1 -- 172.21.15.40:0/890014342 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a48003530 con 0x7f5a600b5d70 2024-05-12T22:52:50.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5e59c640 1 -- 172.21.15.40:0/890014342 >> v2:172.21.15.47:3300/0 conn(0x7f5a60148860 msgr2=0x7f5a60148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:50.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5e59c640 1 --2- 172.21.15.40:0/890014342 >> v2:172.21.15.47:3300/0 conn(0x7f5a60148860 0x7f5a60148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5e59c640 1 -- 172.21.15.40:0/890014342 >> v1:172.21.15.40:6789/0 conn(0x7f5a600b5d70 legacy=0x7f5a600b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.715+0000 7f5a5e59c640 1 -- 172.21.15.40:0/890014342 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a600b4e70 con 0x7f5a601422a0 2024-05-12T22:52:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5e59c640 1 --2- 172.21.15.40:0/890014342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a601422a0 0x7f5a60142730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a600736d0 tx=0x7f5a5401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313f77c3b6a25ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5dd9b640 1 -- 172.21.15.40:0/890014342 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540b0070 con 0x7f5a601422a0 2024-05-12T22:52:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5dd9b640 1 -- 172.21.15.40:0/890014342 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a540ab600 con 0x7f5a601422a0 2024-05-12T22:52:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5dd9b640 1 -- 172.21.15.40:0/890014342 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540ab9d0 con 0x7f5a601422a0 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/890014342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a601422a0 msgr2=0x7f5a60142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- 172.21.15.40:0/890014342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a601422a0 0x7f5a60142730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a600736d0 tx=0x7f5a5401c360 comp rx=0 tx=0).stop 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/890014342 shutdown_connections 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- 172.21.15.40:0/890014342 >> v2:172.21.15.47:3300/0 conn(0x7f5a60148860 0x7f5a60148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- 172.21.15.40:0/890014342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a601422a0 0x7f5a60142730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/890014342 >> 172.21.15.40:0/890014342 conn(0x7f5a6006b6c0 msgr2=0x7f5a6006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/890014342 shutdown_connections 2024-05-12T22:52:50.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/890014342 wait complete. 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 Processor -- start 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- start start 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601422a0 0x7f5a600b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 0x7f5a601e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60152710 con 0x7f5a600b5d70 2024-05-12T22:52:50.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60152590 con 0x7f5a60148860 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f5a60152890 con 0x7f5a601422a0 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49488/0 (socket says 172.21.15.40:49488) 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 -- 172.21.15.40:0/942979748 learned_addr learned my addr 172.21.15.40:0/942979748 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5f59e640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 0x7f5a601e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5e59c640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601422a0 0x7f5a600b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 -- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601422a0 msgr2=0x7f5a600b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601422a0 0x7f5a600b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 -- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 msgr2=0x7f5a601e2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 0x7f5a601e2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 -- 172.21.15.40:0/942979748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a60138400 con 0x7f5a600b5d70 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5f59e640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 0x7f5a601e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a5ed9d640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c450 tx=0x7f5a5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50017070 con 0x7f5a600b5d70 2024-05-12T22:52:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50005cf0 con 0x7f5a600b5d70 2024-05-12T22:52:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a60137b60 con 0x7f5a600b5d70 2024-05-12T22:52:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.719+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50007290 con 0x7f5a600b5d70 2024-05-12T22:52:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a60137880 con 0x7f5a600b5d70 2024-05-12T22:52:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a60068330 con 0x7f5a600b5d70 2024-05-12T22:52:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a5001a070 con 0x7f5a600b5d70 2024-05-12T22:52:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a477fe640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 0x7f5a4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5a50085090 con 0x7f5a600b5d70 2024-05-12T22:52:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a5e59c640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 0x7f5a4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.723+0000 7f5a5e59c640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 0x7f5a4c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a540ad000 tx=0x7f5a54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.727+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5a50055bd0 con 0x7f5a600b5d70 2024-05-12T22:52:50.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.883+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a60148fb0 con 0x7f5a600b5d70 2024-05-12T22:52:50.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.883+0000 7f5a477fe640 1 -- 172.21.15.40:0/942979748 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f5a500554d0 con 0x7f5a600b5d70 2024-05-12T22:52:50.884 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-05-12T22:52:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 msgr2=0x7f5a4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 0x7f5a4c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a540ad000 tx=0x7f5a54008040 comp rx=0 tx=0).stop 2024-05-12T22:52:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 msgr2=0x7f5a601408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c450 tx=0x7f5a5000c910 comp rx=0 tx=0).stop 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 shutdown_connections 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f5a4c0678c0 0x7f5a4c069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a60148860 0x7f5a601e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5a601422a0 0x7f5a600b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 --2- 172.21.15.40:0/942979748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a600b5d70 0x7f5a601408d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 >> 172.21.15.40:0/942979748 conn(0x7f5a6006b6c0 msgr2=0x7f5a600b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 shutdown_connections 2024-05-12T22:52:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:50.887+0000 7f5a651c8640 1 -- 172.21.15.40:0/942979748 wait complete. 2024-05-12T22:52:50.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.023+0000 7f84b7f04640 1 Processor -- start 2024-05-12T22:52:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.023+0000 7f84b7f04640 1 -- start start 2024-05-12T22:52:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b7f04640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84b00b66e0 0x7f84b0145300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b7f04640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00b7300 con 0x7f84b0072f40 2024-05-12T22:52:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b7f04640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00b8210 con 0x7f84b00b7e30 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b7f04640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f84b00b5a20 con 0x7f84b00b66e0 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84b00b66e0 0x7f84b0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84b00b66e0 0x7f84b0145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49492/0 (socket says 172.21.15.40:49492) 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 -- 172.21.15.40:0/2183540716 learned_addr learned my addr 172.21.15.40:0/2183540716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b549f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84b0072f40 0x7f84b014db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34548/0 (socket says 172.21.15.40:34548) 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 -- 172.21.15.40:0/2183540716 >> v1:172.21.15.47:6789/0 conn(0x7f84b00b7e30 legacy=0x7f84b00b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 -- 172.21.15.40:0/2183540716 >> v1:172.21.15.40:6789/0 conn(0x7f84b0072f40 legacy=0x7f84b014db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 -- 172.21.15.40:0/2183540716 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b00b7020 con 0x7f84b00b66e0 2024-05-12T22:52:51.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b64a1640 1 --2- 172.21.15.40:0/2183540716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b00b66e0 0x7f84b0145300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009e50 tx=0x7f84a801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50714a3539f1d2d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b4c9e640 1 -- 172.21.15.40:0/2183540716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a5590 con 0x7f84b00b66e0 2024-05-12T22:52:51.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b4c9e640 1 -- 172.21.15.40:0/2183540716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a80a5730 con 0x7f84b00b66e0 2024-05-12T22:52:51.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.027+0000 7f84b4c9e640 1 -- 172.21.15.40:0/2183540716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a5b00 con 0x7f84b00b66e0 2024-05-12T22:52:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/2183540716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b00b66e0 msgr2=0x7f84b0145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 --2- 172.21.15.40:0/2183540716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b00b66e0 0x7f84b0145300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009e50 tx=0x7f84a801c8d0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/2183540716 shutdown_connections 2024-05-12T22:52:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 --2- 172.21.15.40:0/2183540716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b00b66e0 0x7f84b0145300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/2183540716 >> 172.21.15.40:0/2183540716 conn(0x7f84b006b490 msgr2=0x7f84b006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/2183540716 shutdown_connections 2024-05-12T22:52:51.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/2183540716 wait complete. 2024-05-12T22:52:51.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 Processor -- start 2024-05-12T22:52:51.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- start start 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84b00b66e0 0x7f84b0140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 0x7f84b0140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0153e70 con 0x7f84b0072f40 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0153cf0 con 0x7f84b00b7e30 2024-05-12T22:52:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f84b0153ff0 con 0x7f84b00b66e0 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49506/0 (socket says 172.21.15.40:49506) 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 -- 172.21.15.40:0/3614430426 learned_addr learned my addr 172.21.15.40:0/3614430426 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b549f640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84b00b66e0 0x7f84b0140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b64a1640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 0x7f84b0140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 -- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84b00b66e0 msgr2=0x7f84b0140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84b00b66e0 0x7f84b0140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 -- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 msgr2=0x7f84b0140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 0x7f84b0140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 -- 172.21.15.40:0/3614430426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b013bfa0 con 0x7f84b0072f40 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b64a1640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 0x7f84b0140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b5ca0640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b410 tx=0x7f84ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac015030 con 0x7f84b0072f40 2024-05-12T22:52:51.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac004020 con 0x7f84b0072f40 2024-05-12T22:52:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b01413a0 con 0x7f84b0072f40 2024-05-12T22:52:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac004410 con 0x7f84b0072f40 2024-05-12T22:52:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.031+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b013fb00 con 0x7f84b0072f40 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b0068a40 con 0x7f84b0072f40 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84ac018070 con 0x7f84b0072f40 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84a67fc640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 0x7f8494069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84ac085920 con 0x7f84b0072f40 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84b549f640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 0x7f8494069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.035+0000 7f84b549f640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 0x7f8494069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84b006b970 tx=0x7f84a0007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.039+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f84ac0563c0 con 0x7f84b0072f40 2024-05-12T22:52:51.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.239+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84b0142590 con 0x7f84b0072f40 2024-05-12T22:52:51.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.239+0000 7f84a67fc640 1 -- 172.21.15.40:0/3614430426 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7f84ac055cc0 con 0x7f84b0072f40 2024-05-12T22:52:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:51.240 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:52:51.240 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 msgr2=0x7f8494069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 0x7f8494069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84b006b970 tx=0x7f84a0007cd0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 msgr2=0x7f84b013f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b410 tx=0x7f84ac00b8d0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 shutdown_connections 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84940678c0 0x7f8494069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84b00b7e30 0x7f84b0140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84b00b66e0 0x7f84b0140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 --2- 172.21.15.40:0/3614430426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0072f40 0x7f84b013f0b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 >> 172.21.15.40:0/3614430426 conn(0x7f84b006b490 msgr2=0x7f84b0150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 shutdown_connections 2024-05-12T22:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.243+0000 7f84b7f04640 1 -- 172.21.15.40:0/3614430426 wait complete. 2024-05-12T22:52:51.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:52:51.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 Processor -- start 2024-05-12T22:52:51.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 -- start start 2024-05-12T22:52:51.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8d0806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d0806f9a0 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080b6150 con 0x7f8d080b2c90 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.383+0000 7f8d0f30c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8d080b54a0 con 0x7f8d080b5d70 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d8a9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8d081487f0 0x7f8d0814fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34552/0 (socket says 172.21.15.40:34552) 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/713410709 learned_addr learned my addr 172.21.15.40:0/713410709 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8d0806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950913740 0 0) 0x7f8d0806f9a0 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cf4003530 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095842537 0 0) 0x7f8cf4003530 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 msgr2=0x7f8d0806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8d0806f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 >> v1:172.21.15.47:6789/0 conn(0x7f8d080b2c90 legacy=0x7f8d0813f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080b49c0 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f8d00001a00 con 0x7f8d081487f0 2024-05-12T22:52:51.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 >> v1:172.21.15.40:6789/0 conn(0x7f8d081487f0 legacy=0x7f8d0814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8cf40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cf4003f70 0x7f8cf4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4004d50 0x7f8cf40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080b54a0 con 0x7f8cf4003f70 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf400bb60 con 0x7f8cf4004d50 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf400bd60 con 0x7f8d080b5d70 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cf4003f70 0x7f8cf4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8cf40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d8a9640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4004d50 0x7f8cf40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 -- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 msgr2=0x7f8cf40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b5d70 0x7f8cf40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 -- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4004d50 msgr2=0x7f8cf40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4004d50 0x7f8cf40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 -- 172.21.15.40:0/713410709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4003530 con 0x7f8cf4003f70 2024-05-12T22:52:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0d8a9640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4004d50 0x7f8cf40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8d0c8a7640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cf4003f70 0x7f8cf4004810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001750 tx=0x7f8cf801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921589a4bfab9a16 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80013a0 con 0x7f8cf4003f70 2024-05-12T22:52:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf80052f0 con 0x7f8cf4003f70 2024-05-12T22:52:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.387+0000 7f8cfffff640 1 -- 172.21.15.40:0/713410709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8003840 con 0x7f8cf4003f70 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/713410709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cf4003f70 msgr2=0x7f8cf4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/713410709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cf4003f70 0x7f8cf4004810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8001750 tx=0x7f8cf801c3b0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/713410709 reap_dead start 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/713410709 shutdown_connections 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/713410709 >> 172.21.15.40:0/713410709 conn(0x7f8d0806b6c0 msgr2=0x7f8d0806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/713410709 shutdown_connections 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/713410709 wait complete. 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 Processor -- start 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- start start 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 0x7f8d08136f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b6a10 0x7f8d080b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0813fa70 con 0x7f8d081e1f30 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0813f8f0 con 0x7f8cf4003f70 2024-05-12T22:52:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f8d08151a70 con 0x7f8d080b6a10 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49528/0 (socket says 172.21.15.40:49528) 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/1784310219 learned_addr learned my addr 172.21.15.40:0/1784310219 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0c8a7640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b6a10 0x7f8d080b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 0x7f8d08136f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b6a10 msgr2=0x7f8d080b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b6a10 0x7f8d080b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 msgr2=0x7f8d08136f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 0x7f8d08136f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 -- 172.21.15.40:0/1784310219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d08071120 con 0x7f8d081e1f30 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 0x7f8d08136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0d8a9640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000f90 tx=0x7f8d0000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000de90 con 0x7f8d081e1f30 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0000bb80 con 0x7f8d081e1f30 2024-05-12T22:52:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d08071e70 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00007070 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d08072430 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.391+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d08068330 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.395+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d0001b060 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.395+0000 7f8cfdffb640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 0x7f8cec069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.395+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 0x7f8cec069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.395+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d00085d50 con 0x7f8d081e1f30 2024-05-12T22:52:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.395+0000 7f8d0d0a8640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 0x7f8cec069f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009af0 tx=0x7f8d04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.399+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8d000567f0 con 0x7f8d081e1f30 2024-05-12T22:52:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.563+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d080705d0 con 0x7f8d081e1f30 2024-05-12T22:52:51.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.563+0000 7f8cfdffb640 1 -- 172.21.15.40:0/1784310219 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16533 (secure 0 0 0) 0x7f8d000560f0 con 0x7f8d081e1f30 2024-05-12T22:52:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:51.564 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:52:36.540472+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 msgr2=0x7f8cec069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 0x7f8cec069f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009af0 tx=0x7f8d04008040 comp rx=0 tx=0).stop 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 msgr2=0x7f8d081e23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000f90 tx=0x7f8d0000b4a0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 shutdown_connections 2024-05-12T22:52:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d081e1f30 0x7f8d081e23b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d080b6a10 0x7f8d080b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f8cec067a60 0x7f8cec069f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 --2- 172.21.15.40:0/1784310219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf4003f70 0x7f8d08136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 >> 172.21.15.40:0/1784310219 conn(0x7f8d0806b6c0 msgr2=0x7f8d080b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 shutdown_connections 2024-05-12T22:52:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.567+0000 7f8d0f30c640 1 -- 172.21.15.40:0/1784310219 wait complete. 2024-05-12T22:52:51.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:52:51.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.691+0000 7f652c689640 1 Processor -- start 2024-05-12T22:52:51.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 -- start start 2024-05-12T22:52:51.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65240b5d70 0x7f6524148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65240b2c50 0x7f6524148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65240b6150 con 0x7f652413f050 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f652406f990 con 0x7f65240b2c50 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652c689640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f65240708b0 con 0x7f65240b5d70 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65240b2c50 0x7f6524148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65240b2c50 0x7f6524148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49542/0 (socket says 172.21.15.40:49542) 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 -- 172.21.15.40:0/413699696 learned_addr learned my addr 172.21.15.40:0/413699696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f652a425640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65240b5d70 0x7f6524148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 -- 172.21.15.40:0/413699696 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65240b5d70 msgr2=0x7f6524148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65240b5d70 0x7f6524148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 -- 172.21.15.40:0/413699696 >> v1:172.21.15.47:6789/0 conn(0x7f652413f050 legacy=0x7f652413f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 -- 172.21.15.40:0/413699696 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652406f620 con 0x7f65240b2c50 2024-05-12T22:52:51.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529c24640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b2c50 0x7f6524148ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f65140098a0 tx=0x7f651401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5704c8229a00f00 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529423640 1 -- 172.21.15.40:0/413699696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140ab650 con 0x7f65240b2c50 2024-05-12T22:52:51.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529423640 1 -- 172.21.15.40:0/413699696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65140b0070 con 0x7f65240b2c50 2024-05-12T22:52:51.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.695+0000 7f6529423640 1 -- 172.21.15.40:0/413699696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140aba10 con 0x7f65240b2c50 2024-05-12T22:52:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- 172.21.15.40:0/413699696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b2c50 msgr2=0x7f6524148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b2c50 0x7f6524148ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f65140098a0 tx=0x7f651401c470 comp rx=0 tx=0).stop 2024-05-12T22:52:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- 172.21.15.40:0/413699696 shutdown_connections 2024-05-12T22:52:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b2c50 0x7f6524148ea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- 172.21.15.40:0/413699696 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65240b5d70 0x7f6524148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- 172.21.15.40:0/413699696 >> 172.21.15.40:0/413699696 conn(0x7f652406b6c0 msgr2=0x7f652406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- 172.21.15.40:0/413699696 shutdown_connections 2024-05-12T22:52:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- 172.21.15.40:0/413699696 wait complete. 2024-05-12T22:52:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 Processor -- start 2024-05-12T22:52:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- start start 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65240b2c50 0x7f65241416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f652413f050 0x7f65240b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65241526f0 con 0x7f65240b5d70 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6524152570 con 0x7f65240b2c50 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652c689640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f6524152870 con 0x7f652413f050 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49552/0 (socket says 172.21.15.40:49552) 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 -- 172.21.15.40:0/1190640896 learned_addr learned my addr 172.21.15.40:0/1190640896 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652a425640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65240b2c50 0x7f65241416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f652ac26640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f652413f050 0x7f65240b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 -- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f652413f050 msgr2=0x7f65240b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f652413f050 0x7f65240b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 -- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65240b2c50 msgr2=0x7f65241416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65240b2c50 0x7f65241416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 -- 172.21.15.40:0/1190640896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65240b6e00 con 0x7f65240b5d70 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.699+0000 7f6529c24640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f651401ab20 tx=0x7f651401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140b4800 con 0x7f65240b5d70 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65140b49a0 con 0x7f65240b5d70 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65241e0190 con 0x7f65240b5d70 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140b4d90 con 0x7f65240b5d70 2024-05-12T22:52:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65241dfe60 con 0x7f65240b5d70 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6524068330 con 0x7f65240b5d70 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65140c7430 con 0x7f65240b5d70 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 0x7f6508069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f65141206c0 con 0x7f65240b5d70 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f652a425640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 0x7f6508069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.703+0000 7f652a425640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 0x7f6508069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f651c00f510 tx=0x7f651c0077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:51.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.707+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f65140160f0 con 0x7f65240b5d70 2024-05-12T22:52:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.899+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65241e0520 con 0x7f65240b5d70 2024-05-12T22:52:51.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.899+0000 7f651affd640 1 -- 172.21.15.40:0/1190640896 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7f65140f0d60 con 0x7f65240b5d70 2024-05-12T22:52:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:52:51.901 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:52:51.901 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 msgr2=0x7f6508069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 0x7f6508069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f651c00f510 tx=0x7f651c0077b0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 msgr2=0x7f65240ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f651401ab20 tx=0x7f651401acb0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 shutdown_connections 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f652413f050 0x7f65240b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65240b5d70 0x7f65240ad8d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65080678c0 0x7f6508069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 --2- 172.21.15.40:0/1190640896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65240b2c50 0x7f65241416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 >> 172.21.15.40:0/1190640896 conn(0x7f652406b6c0 msgr2=0x7f6524072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 shutdown_connections 2024-05-12T22:52:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:51.903+0000 7f652c689640 1 -- 172.21.15.40:0/1190640896 wait complete. 2024-05-12T22:52:52.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-12T22:52:34.894154+0000', 'modified': '2024-05-12T22:52:36.884030+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3972544441', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3972544441}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3972544441}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-05-12T22:52:52.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-12T22:52:52.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-12T22:52:52.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.251+0000 7f7841733640 1 Processor -- start 2024-05-12T22:52:52.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.251+0000 7f7841733640 1 -- start start 2024-05-12T22:52:52.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7841733640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f783c0b5d70 0x7f783c148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7841733640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0b6150 con 0x7f783c13f760 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7841733640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c06f620 con 0x7f783c0b2c50 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7841733640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f783c06f990 con 0x7f783c0b5d70 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f783c13f760 0x7f783c14fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34566/0 (socket says 172.21.15.40:34566) 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 -- 172.21.15.40:0/3756880374 learned_addr learned my addr 172.21.15.40:0/3756880374 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783affd640 1 --2- 172.21.15.40:0/3756880374 >> v2:172.21.15.47:3300/0 conn(0x7f783c0b5d70 0x7f783c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712788634 0 0) 0x7f783c0b6150 con 0x7f783c13f760 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7824003530 con 0x7f783c13f760 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3056706998 0 0) 0x7f7824003530 con 0x7f783c13f760 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 >> v2:172.21.15.47:3300/0 conn(0x7f783c0b5d70 msgr2=0x7f783c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 --2- 172.21.15.40:0/3756880374 >> v2:172.21.15.47:3300/0 conn(0x7f783c0b5d70 0x7f783c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 >> v1:172.21.15.47:6789/0 conn(0x7f783c0b2c50 legacy=0x7f783c13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0b4ea0 con 0x7f783c13f760 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f7834001a00 con 0x7f783c13f760 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783affd640 1 --2- 172.21.15.40:0/3756880374 >> v2:172.21.15.47:3300/0 conn(0x7f783c0b5d70 0x7f783c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 >> v1:172.21.15.40:6789/0 conn(0x7f783c13f760 legacy=0x7f783c14fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240039c0 0x7f7824003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7824004810 0x7f7824004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 0x7f782400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f782400c140 con 0x7f78240051d0 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7824010700 con 0x7f7824004810 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7824010900 con 0x7f78240039c0 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 0x7f782400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783a7fc640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7824004810 0x7f7824004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783affd640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240039c0 0x7f7824003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 -- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240039c0 msgr2=0x7f7824003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240039c0 0x7f7824003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 -- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7824004810 msgr2=0x7f7824004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7824004810 0x7f7824004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.255+0000 7f783b7fe640 1 -- 172.21.15.40:0/3756880374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7824003530 con 0x7f78240051d0 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f783b7fe640 1 -- 172.21.15.40:0/3756880374 reap_dead start 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 0x7f782400b9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f783400a860 tx=0x7f783401fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f270e487d9ba940 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783400a480 con 0x7f78240051d0 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78340aa510 con 0x7f78240051d0 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7839ffb640 1 -- 172.21.15.40:0/3756880374 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340aa8e0 con 0x7f78240051d0 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 msgr2=0x7f782400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 0x7f782400b9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f783400a860 tx=0x7f783401fae0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- 172.21.15.40:0/3756880374 shutdown_connections 2024-05-12T22:52:52.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 --2- 172.21.15.40:0/3756880374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78240051d0 0x7f782400b9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- 172.21.15.40:0/3756880374 >> 172.21.15.40:0/3756880374 conn(0x7f783c06b6c0 msgr2=0x7f783c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- 172.21.15.40:0/3756880374 shutdown_connections 2024-05-12T22:52:52.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- 172.21.15.40:0/3756880374 wait complete. 2024-05-12T22:52:52.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 Processor -- start 2024-05-12T22:52:52.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- start start 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240051d0 0x7f783c1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 0x7f783c071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0b52e0 con 0x7f783c13ade0 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0b5160 con 0x7f783c072c30 2024-05-12T22:52:52.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.259+0000 7f7841733640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f783c13f050 con 0x7f78240051d0 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49568/0 (socket says 172.21.15.40:49568) 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 -- 172.21.15.40:0/1612266829 learned_addr learned my addr 172.21.15.40:0/1612266829 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783affd640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240051d0 0x7f783c1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783a7fc640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 0x7f783c071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 -- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240051d0 msgr2=0x7f783c1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240051d0 0x7f783c1404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 -- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 msgr2=0x7f783c071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 0x7f783c071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 -- 172.21.15.40:0/1612266829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c140b20 con 0x7f783c13ade0 2024-05-12T22:52:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783a7fc640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 0x7f783c071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783b7fe640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78340012f0 tx=0x7f7824005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 -- 172.21.15.40:0/1612266829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340bd070 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 -- 172.21.15.40:0/1612266829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78340aa6c0 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 -- 172.21.15.40:0/1612266829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783400a480 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c140e00 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c141730 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 -- 172.21.15.40:0/1612266829 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78340b3050 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 0x7f7828069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78237fe640 1 -- 172.21.15.40:0/1612266829 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7834122910 con 0x7f783c13ade0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783affd640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 0x7f7828069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f783affd640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 0x7f7828069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f782c009b40 tx=0x7f782c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78448ad000 1 Processor -- start 2024-05-12T22:52:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.263+0000 7f78448ad000 1 -- start start 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee328d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee333c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621ee145c20 con 0x5621ee2fe2a0 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5621ee0e2a80 con 0x5621ee3289a0 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x5621ee141be0 con 0x5621ee3292c0 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49578/0 (socket says 172.21.15.40:49578) 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 -- 172.21.15.40:0/2252161234 learned_addr learned my addr 172.21.15.40:0/2252161234 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783a7fc640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee328d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee333c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 -- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 msgr2=0x5621ee333c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee333c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 -- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 msgr2=0x5621ee328d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee328d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 -- 172.21.15.40:0/2252161234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ee0ccb20 con 0x5621ee2fe2a0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783a7fc640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee328d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f782c013ef0 tx=0x7f782c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c7729a3d4ffb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7820ff9640 1 -- 172.21.15.40:0/2252161234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c023640 con 0x5621ee2fe2a0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7820ff9640 1 -- 172.21.15.40:0/2252161234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c028070 con 0x5621ee2fe2a0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7820ff9640 1 -- 172.21.15.40:0/2252161234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c0239e0 con 0x5621ee2fe2a0 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2252161234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 msgr2=0x5621ee326e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f782c013ef0 tx=0x7f782c016000 comp rx=0 tx=0).stop 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2252161234 shutdown_connections 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee333c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee328d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- 172.21.15.40:0/2252161234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee326e70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2252161234 >> 172.21.15.40:0/2252161234 conn(0x5621ee1dfdf0 msgr2=0x5621ee326760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2252161234 shutdown_connections 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2252161234 wait complete. 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- start start 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 Processor -- start 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee2fe2a0 0x5621ee2fa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3289a0 0x5621ee2fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621ee103000 con 0x5621ee3292c0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5621ee2033f0 con 0x5621ee2fe2a0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x5621ee0ed470 con 0x5621ee3289a0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 10 client.0 _ll_register_callbacks cb 0x5621ee2e3aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49588/0 (socket says 172.21.15.40:49588) 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 -- 172.21.15.40:0/2782452472 learned_addr learned my addr 172.21.15.40:0/2782452472 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783affd640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee2fe2a0 0x5621ee2fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783a7fc640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3289a0 0x5621ee2fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 -- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3289a0 msgr2=0x5621ee2fa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3289a0 0x5621ee2fa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 -- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee2fe2a0 msgr2=0x5621ee2fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee2fe2a0 0x5621ee2fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 -- 172.21.15.40:0/2782452472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ee0cde80 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f783b7fe640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f783409c220 tx=0x7f78340f2e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333ea909e09db2c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340f2190 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f78340f2330 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.267+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f782c028070 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f78340f92f0 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 10 client.4671 fetch_fsmap learned FSMap version 6 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5621ee112760 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c028070 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f78340f9490 con 0x5621ee3292c0 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 10 client.4671 fetch_fsmap finished waiting for FSMap version 6 2024-05-12T22:52:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 20 client.4671 populate_metadata read hostname 'smithi040' 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee33ca80 0x5621ee33ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 4 client.4671 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 --> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621ee0e0ab0 con 0x5621ee33ca80 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f783affd640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee33ca80 0x5621ee33ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f783affd640 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee33ca80 0x5621ee33ee70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73e5a03e018da4f server_cookie=6df0bfef79d0c2bf in_seq=0 out_seq=0 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 10 client.4671 ms_handle_connect on v2:172.21.15.40:6834/3972544441 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 1 -- 172.21.15.40:0/2782452472 <== mds.0 v2:172.21.15.40:6834/3972544441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621ee0e0ab0 con 0x5621ee33ca80 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 10 client.4671 handle_command_reply: tid=0 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 client.4671 shutdown 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 msgr2=0x5621ee2fae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f783409c220 tx=0x7f78340f2e00 comp rx=0 tx=0).stop 2024-05-12T22:52:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 shutdown_connections 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee33ca80 0x5621ee33ee70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee3292c0 0x5621ee2fae00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f7819ffb640 0 client.4671 ms_handle_reset on v2:172.21.15.40:6834/3972544441 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3289a0 0x5621ee2fa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 --2- 172.21.15.40:0/2782452472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee2fe2a0 0x5621ee2fa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 >> 172.21.15.40:0/2782452472 conn(0x5621ee1dfdf0 msgr2=0x5621ee326760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 shutdown_connections 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 1 -- 172.21.15.40:0/2782452472 wait complete. 2024-05-12T22:52:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.271+0000 7f78448ad000 20 client.4671 trim_cache size 0 max 16384 2024-05-12T22:52:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 Processor -- start 2024-05-12T22:52:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- start start 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee341ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee3423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621ee3272a0 con 0x5621ee2fe2a0 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f783c1e5970 con 0x5621ee3289a0 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f783c1e4a80 con 0x5621ee3292c0 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49604/0 (socket says 172.21.15.40:49604) 2024-05-12T22:52:52.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/2333704898 learned_addr learned my addr 172.21.15.40:0/2333704898 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783a7fc640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee341ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783b7fe640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee3423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 msgr2=0x5621ee3423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee3423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 msgr2=0x5621ee341ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee341ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/2333704898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ee19ed10 con 0x5621ee2fe2a0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783a7fc640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee341ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f782c025040 tx=0x7f782c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6956441b9809026 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f781bfff640 1 -- 172.21.15.40:0/2333704898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c004020 con 0x5621ee2fe2a0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f781bfff640 1 -- 172.21.15.40:0/2333704898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c028040 con 0x5621ee2fe2a0 2024-05-12T22:52:52.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f781bfff640 1 -- 172.21.15.40:0/2333704898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c004400 con 0x5621ee2fe2a0 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- 172.21.15.40:0/2333704898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 msgr2=0x5621ee339e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f782c025040 tx=0x7f782c01a000 comp rx=0 tx=0).stop 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- 172.21.15.40:0/2333704898 shutdown_connections 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee3423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee341ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- 172.21.15.40:0/2333704898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee339e30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- 172.21.15.40:0/2333704898 >> 172.21.15.40:0/2333704898 conn(0x5621ee1dfdf0 msgr2=0x5621ee339720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- 172.21.15.40:0/2333704898 shutdown_connections 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- 172.21.15.40:0/2333704898 wait complete. 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- start start 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 Processor -- start 2024-05-12T22:52:52.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee39a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee39aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621ee0dd7b0 con 0x5621ee2fe2a0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5621ee0cd8f0 con 0x5621ee3289a0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x5621ee144f30 con 0x5621ee3292c0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f78448ad000 10 client.0 _ll_register_callbacks cb 0x7f783400a620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49618/0 (socket says 172.21.15.40:49618) 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/3925138887 learned_addr learned my addr 172.21.15.40:0/3925138887 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783a7fc640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee39a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee39aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 msgr2=0x5621ee39aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee39aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 msgr2=0x5621ee39a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee39a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 -- 172.21.15.40:0/3925138887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ee0d4b60 con 0x5621ee2fe2a0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783b7fe640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee39aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f783affd640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f782c00b010 tx=0x7f782c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891b1c530157012c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.291+0000 7f7819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c047020 con 0x5621ee2fe2a0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f782c004020 con 0x5621ee2fe2a0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f782c028040 con 0x5621ee2fe2a0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f782c051050 con 0x5621ee2fe2a0 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 10 client.4677 fetch_fsmap learned FSMap version 6 2024-05-12T22:52:52.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5621ee0ebed0 con 0x5621ee2fe2a0 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c028040 con 0x5621ee2fe2a0 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f782c054020 con 0x5621ee2fe2a0 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 10 client.4677 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 20 client.4677 populate_metadata read hostname 'smithi040' 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee398d60 0x5621ee399140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 4 client.4677 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 --> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] -- command(tid 0: {"prefix": "status"}) -- 0x5621ee153350 con 0x5621ee398d60 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f783a7fc640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee398d60 0x5621ee399140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 10 client.4677 ms_handle_connect on v2:172.21.15.40:6834/3972544441 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f783a7fc640 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee398d60 0x5621ee399140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495d751207ed5f0e server_cookie=fb199eb8b1a4602e in_seq=0 out_seq=0 2024-05-12T22:52:52.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 1 -- 172.21.15.40:0/3925138887 <== mds.0 v2:172.21.15.40:6834/3972544441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5621ee153350 con 0x5621ee398d60 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 10 client.4677 handle_command_reply: tid=0 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 client.4677 shutdown 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 msgr2=0x5621ee399f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f782c00b010 tx=0x7f782c004740 comp rx=0 tx=0).stop 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 shutdown_connections 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:6834/3972544441,v1:172.21.15.40:6835/3972544441] conn(0x5621ee398d60 0x5621ee399140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5621ee3292c0 0x5621ee39aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621ee3289a0 0x5621ee39a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 --2- 172.21.15.40:0/3925138887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ee2fe2a0 0x5621ee399f80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7819ffb640 0 client.4677 ms_handle_reset on v2:172.21.15.40:6834/3972544441 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 >> 172.21.15.40:0/3925138887 conn(0x5621ee1dfdf0 msgr2=0x5621ee339fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 shutdown_connections 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 1 -- 172.21.15.40:0/3925138887 wait complete. 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f78448ad000 20 client.4677 trim_cache size 0 max 16384 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "b0a63ee2-381a-4a33-b1a1-0e740f041feb", 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4272, 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-05-12T22:52:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 16.772310177000001, 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 6, 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 21, 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 21, 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 23.590900398999999 2024-05-12T22:52:52.305 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 msgr2=0x7f7828069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 0x7f7828069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f782c009b40 tx=0x7f782c008040 comp rx=0 tx=0).stop 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 msgr2=0x7f783c13b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78340012f0 tx=0x7f7824005840 comp rx=0 tx=0).stop 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 shutdown_connections 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f783c13ade0 0x7f783c13b260 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f78280678f0 0x7f7828069db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f783c072c30 0x7f783c071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 --2- 172.21.15.40:0/1612266829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78240051d0 0x7f783c1404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 >> 172.21.15.40:0/1612266829 conn(0x7f783c06b6c0 msgr2=0x7f783c1431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 shutdown_connections 2024-05-12T22:52:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.295+0000 7f7841733640 1 -- 172.21.15.40:0/1612266829 wait complete. 2024-05-12T22:52:52.312 INFO:teuthology.run_tasks:Running task sequential... 2024-05-12T22:52:52.321 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-12T22:52:52.322 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-12T22:52:52.322 INFO:teuthology.task.print:Enabling mgr modules 2024-05-12T22:52:52.322 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-12T22:52:52.345 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-12T22:52:52.345 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-12T22:52:52.346 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-12T22:52:52.346 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-12T22:52:52.346 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:52.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:52.346 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-05-12T22:52:52.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:52.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-05-12T22:52:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-05-12T22:52:52.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:52:52.411 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-12T22:52:52.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-12T22:52:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 Processor -- start 2024-05-12T22:52:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 -- start start 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3680b5f00 0x7fc3681411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36806d510 con 0x7fc3680b7d40 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680b8120 con 0x7fc368072f90 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc370181640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc36806db20 con 0x7fc3680b5f00 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36df1d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc3680b7d40 0x7fc3680b6600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34568/0 (socket says 172.21.15.40:34568) 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36df1d640 1 -- 172.21.15.40:0/1148048522 learned_addr learned my addr 172.21.15.40:0/1148048522 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36d71c640 1 --2- 172.21.15.40:0/1148048522 >> v2:172.21.15.47:3300/0 conn(0x7fc3680b5f00 0x7fc3681411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054378382 0 0) 0x7fc36806d510 con 0x7fc3680b7d40 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc354003530 con 0x7fc3680b7d40 2024-05-12T22:52:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1037628023 0 0) 0x7fc354003530 con 0x7fc3680b7d40 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 >> v2:172.21.15.47:3300/0 conn(0x7fc3680b5f00 msgr2=0x7fc3681411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 --2- 172.21.15.40:0/1148048522 >> v2:172.21.15.47:3300/0 conn(0x7fc3680b5f00 0x7fc3681411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 >> v1:172.21.15.47:6789/0 conn(0x7fc368072f90 legacy=0x7fc368141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36806d7b0 con 0x7fc3680b7d40 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fc3640016a0 con 0x7fc3680b7d40 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 >> v1:172.21.15.40:6789/0 conn(0x7fc3680b7d40 legacy=0x7fc3680b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540039c0 0x7fc354003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354004810 0x7fc354004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 0x7fc35400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc36806db20 con 0x7fc3540051d0 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc35400c070 con 0x7fc354004810 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc35400c270 con 0x7fc3540039c0 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 0x7fc35400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36d71c640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354004810 0x7fc354004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36df1d640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540039c0 0x7fc354003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 -- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540039c0 msgr2=0x7fc354003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540039c0 0x7fc354003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 -- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354004810 msgr2=0x7fc354004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354004810 0x7fc354004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.575+0000 7fc36e71e640 1 -- 172.21.15.40:0/1148048522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc354003530 con 0x7fc3540051d0 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc36e71e640 1 -- 172.21.15.40:0/1148048522 reap_dead start 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc36e71e640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 0x7fc35400b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc360001e40 tx=0x7fc36001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd919a6bee1f4a92 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360001a90 con 0x7fc3540051d0 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360003b80 con 0x7fc3540051d0 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc36cf1b640 1 -- 172.21.15.40:0/1148048522 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360005020 con 0x7fc3540051d0 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 msgr2=0x7fc35400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 0x7fc35400b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc360001e40 tx=0x7fc36001c760 comp rx=0 tx=0).stop 2024-05-12T22:52:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- 172.21.15.40:0/1148048522 shutdown_connections 2024-05-12T22:52:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 --2- 172.21.15.40:0/1148048522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540051d0 0x7fc35400b9d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- 172.21.15.40:0/1148048522 >> 172.21.15.40:0/1148048522 conn(0x7fc36806b490 msgr2=0x7fc36806b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- 172.21.15.40:0/1148048522 shutdown_connections 2024-05-12T22:52:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- 172.21.15.40:0/1148048522 wait complete. 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 Processor -- start 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.579+0000 7fc370181640 1 -- start start 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 0x7fc3680b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 0x7fc368142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680b6600 con 0x7fc3681439a0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680b6780 con 0x7fc368143e20 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc3680b6900 con 0x7fc3540051d0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49642/0 (socket says 172.21.15.40:49642) 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 -- 172.21.15.40:0/2302326752 learned_addr learned my addr 172.21.15.40:0/2302326752 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36df1d640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 0x7fc3680b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36e71e640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 0x7fc368142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 -- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 msgr2=0x7fc3680b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 0x7fc3680b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 -- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 msgr2=0x7fc368142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 0x7fc368142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 -- 172.21.15.40:0/2302326752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc368144e10 con 0x7fc3681439a0 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36df1d640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 0x7fc3680b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36e71e640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 0x7fc368142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:52:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36d71c640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc358011510 tx=0x7fc3580119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358015870 con 0x7fc3681439a0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358015a10 con 0x7fc3681439a0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358015e00 con 0x7fc3681439a0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3681cea20 con 0x7fc3681439a0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3680b5060 con 0x7fc3681439a0 2024-05-12T22:52:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3681cd940 con 0x7fc3681439a0 2024-05-12T22:52:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc35801d400 con 0x7fc3681439a0 2024-05-12T22:52:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 0x7fc34c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:52:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3580864f0 con 0x7fc3681439a0 2024-05-12T22:52:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36df1d640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 0x7fc34c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:52:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.583+0000 7fc36df1d640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 0x7fc34c069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc36806d6e0 tx=0x7fc364001c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:52:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.587+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc3681cd940 con 0x7fc3681439a0 2024-05-12T22:52:52.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.787+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc368068330 con 0x7fc3681439a0 2024-05-12T22:52:52.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc35e7fc640 1 -- 172.21.15.40:0/2302326752 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fc358084e20 con 0x7fc3681439a0 2024-05-12T22:52:52.790 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 msgr2=0x7fc34c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 0x7fc34c069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc36806d6e0 tx=0x7fc364001c80 comp rx=0 tx=0).stop 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 msgr2=0x7fc368141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc358011510 tx=0x7fc3580119d0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 shutdown_connections 2024-05-12T22:52:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc34c0678c0 0x7fc34c069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc368143e20 0x7fc368142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3681439a0 0x7fc368141ee0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 --2- 172.21.15.40:0/2302326752 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3540051d0 0x7fc3680b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 >> 172.21.15.40:0/2302326752 conn(0x7fc36806b490 msgr2=0x7fc3680715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 shutdown_connections 2024-05-12T22:52:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52.791+0000 7fc370181640 1 -- 172.21.15.40:0/2302326752 wait complete. 2024-05-12T22:52:52.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-12T22:52:52.808 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-12T22:52:52.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:52.809 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-12T22:52:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:45:0e:0f:c8 brd ff:ff:ff:ff:ff:ff 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-12T22:52:52.816 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-05-12T22:52:52.817 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-12T22:52:52.817 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-05-12T22:52:52.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T22:52:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:52.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:52.936 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-12T22:52:52.986 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-05-12T22:52:52.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:52.987 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-12T22:52:53.050 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-12T22:52:53.051 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-05-12T22:52:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T22:52:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:53.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:53.185 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-05-12T22:52:53.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:53.191 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-05-12T22:52:53.238 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T22:52:53.238 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-05-12T22:52:53.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:53.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-12T22:52:53.238 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-05-12T22:52:53.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T22:52:53.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:53.357 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-12T22:52:53.357 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-12T22:52:53.358 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-05-12T22:52:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T22:52:53.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:53.473 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-12T22:52:53.473 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-05-12T22:52:53.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-05-12T22:52:53.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-05-12T22:52:53.473 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-05-12T22:52:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-12T22:52:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:53.532 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-12T22:52:53.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T22:52:53.532 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:53.581 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-12T22:52:53.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-12T22:52:53.582 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:53.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-05-12T22:52:53.690 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T22:52:53.743 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-05-12T22:52:53.743 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-05-12T22:52:53.744 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-05-12T22:52:53.745 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:53.746 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:53.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:53.747 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-05-12T22:52:53.795 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-12T22:52:53.795 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-12T22:52:53.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-05-12T22:52:53.854 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T22:52:53.903 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-05-12T22:52:53.904 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-05-12T22:52:53.905 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:53.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:53.907 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-05-12T22:52:53.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-05-12T22:52:53.919+0000 7fa457308580 -1 init, newargv = 0x55c9a5db2ae0 newargc=15 2024-05-12T22:52:53.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[33224]: starting ceph client 2024-05-12T22:52:53.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[33224]: starting fuse 2024-05-12T22:52:55.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-05-12T22:52:55.044 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-05-12T22:52:55.093 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-05-12T22:52:55.094 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-05-12T22:52:55.095 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-05-12T22:52:55.095 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-05-12T22:52:55.095 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:55.095 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:52:55.095 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:55.096 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-05-12T22:52:55.143 INFO:teuthology.orchestra.run.smithi040.stdout:45 2024-05-12T22:52:55.143 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> 2024-05-12T22:52:55.143 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-05-12T22:52:55.144 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-05-12T22:52:55.145 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-05-12T22:52:55.145 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-12T22:52:55.145 DEBUG:teuthology.orchestra.run.smithi040:> 2024-05-12T22:52:55.145 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-05-12T22:52:55.145 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-05-12T22:52:55.270 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.33224.asok 2024-05-12T22:52:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:52:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-12T22:52:55.281 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33224.asok 2024-05-12T22:52:55.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:55.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33224.asok status 2024-05-12T22:52:55.439 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:52:55.439 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-05-12T22:52:55.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "f72fecff68e1d400c4568684327c900485c20d6a", 2024-05-12T22:52:55.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-2555-gf72fecff (f72fecff68e1d400c4568684327c900485c20d6a) squid (dev)", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "33224", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4689, 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4689 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-05-12T22:52:55.440 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1356440259 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1356440259 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4689 192.168.0.1:0/1356440259", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1356440259", 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2024-05-12T22:52:55.441 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 21, 2024-05-12T22:52:55.442 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-05-12T22:52:55.442 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-05-12T22:52:55.442 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-05-12T22:52:55.442 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:52:55.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:55.453 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-05-12T22:52:55.453 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.459 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-05-12T22:52:55.459 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:52:55.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.515 INFO:teuthology.run_tasks:Running task workunit... 2024-05-12T22:52:55.527 INFO:tasks.workunit:Pulling workunits from ref c50db29d375ad9ca1a200449f9347b89e25fb278 2024-05-12T22:52:55.527 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-12T22:52:55.527 INFO:tasks.workunit:timeout=3h 2024-05-12T22:52:55.527 INFO:tasks.workunit:cleanup=True 2024-05-12T22:52:55.528 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-05-12 22:52:35.526064403 +0000 2024-05-12T22:52:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-05-12 22:52:55.514805070 +0000 2024-05-12T22:52:55.569 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-05-12T22:52:55.569 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-12T22:52:55.569 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-12T22:52:55.640 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c50db29d375ad9ca1a200449f9347b89e25fb278 2024-05-12T22:52:55.693 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-12T22:53:01.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:53:01.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:53:31.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:53:32.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:54:02.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:54:02.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to 'c50db29d375ad9ca1a200449f9347b89e25fb278'. 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-12T22:54:05.341 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:54:05.342 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at c50db29d375 Merge pull request #57417 from zdover23/wip-doc-2024-05-12-backport-57415-to-squid 2024-05-12T22:54:05.345 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-12T22:54:05.352 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-12T22:54:05.355 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:54:05.355 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-12T22:54:06.187 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-12T22:54:06.279 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-12T22:54:06.340 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:54:06.341 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:54:06.342 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-12T22:54:06.395 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:54:06.399 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:54:06.399 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-12T22:54:06.450 INFO:tasks.workunit:Running workunits matching fs/misc/acl.sh on client.0... 2024-05-12T22:54:06.452 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-05-12T22:54:06.452 DEBUG:teuthology.orchestra.run.smithi040:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c50db29d375ad9ca1a200449f9347b89e25fb278 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-05-12T22:54:06.514 INFO:tasks.workunit.client.0.smithi040.stderr:+ set -e 2024-05-12T22:54:06.514 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir -p testdir 2024-05-12T22:54:06.518 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd testdir 2024-05-12T22:54:06.518 INFO:tasks.workunit.client.0.smithi040.stderr:+ set +e 2024-05-12T22:54:06.518 INFO:tasks.workunit.client.0.smithi040.stderr:+ setfacl -d -m u:nobody:rw . 2024-05-12T22:54:06.530 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:54:06.530 INFO:tasks.workunit.client.0.smithi040.stderr:+ set -e 2024-05-12T22:54:06.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=0 2024-05-12T22:54:06.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 0 -lt 100 ] 2024-05-12T22:54:06.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 0 + 1 2024-05-12T22:54:06.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=1 2024-05-12T22:54:06.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:06.534 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:06.534 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:06.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:06.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:06.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:07.140 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.164 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:07.326 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:07.354 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.354 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.354 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 1 -lt 100 ] 2024-05-12T22:54:07.354 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 1 + 1 2024-05-12T22:54:07.391 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=2 2024-05-12T22:54:07.391 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:07.406 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.406 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.409 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:07.409 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:07.409 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:07.831 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.833 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.854 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:07.854 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:07.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -lt 100 ] 2024-05-12T22:54:07.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 2 + 1 2024-05-12T22:54:07.864 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=3 2024-05-12T22:54:07.864 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:07.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.871 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:07.871 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:07.871 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:07.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.962 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:07.962 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:07.966 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.966 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:07.966 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 3 -lt 100 ] 2024-05-12T22:54:07.966 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 3 + 1 2024-05-12T22:54:07.970 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=4 2024-05-12T22:54:07.970 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:07.986 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:07.986 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:07.988 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:07.988 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:07.988 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:08.054 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.054 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.066 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:08.067 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:08.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 4 -lt 100 ] 2024-05-12T22:54:08.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 4 + 1 2024-05-12T22:54:08.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=5 2024-05-12T22:54:08.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:08.081 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.081 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.083 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:08.083 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:08.083 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:08.166 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.168 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:08.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:08.188 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.189 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.189 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 5 -lt 100 ] 2024-05-12T22:54:08.189 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 5 + 1 2024-05-12T22:54:08.192 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=6 2024-05-12T22:54:08.192 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:08.198 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.198 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.199 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:08.199 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:08.199 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:08.271 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.271 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.285 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:08.285 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:08.288 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.289 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.289 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 6 -lt 100 ] 2024-05-12T22:54:08.289 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 6 + 1 2024-05-12T22:54:08.292 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=7 2024-05-12T22:54:08.292 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:08.296 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.296 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.298 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:08.298 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:08.298 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:08.386 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.387 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:08.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:08.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 7 -lt 100 ] 2024-05-12T22:54:08.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 7 + 1 2024-05-12T22:54:08.418 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=8 2024-05-12T22:54:08.419 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:08.424 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.424 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.425 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:08.425 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:08.426 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:08.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.725 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:08.725 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:08.748 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.748 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:08.749 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 8 -lt 100 ] 2024-05-12T22:54:08.749 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 8 + 1 2024-05-12T22:54:08.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=9 2024-05-12T22:54:08.774 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:08.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:08.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:08.791 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:08.791 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:08.791 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:09.206 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:09.207 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:09.303 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:09.303 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:09.316 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:09.316 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:09.316 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 9 -lt 100 ] 2024-05-12T22:54:09.316 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 9 + 1 2024-05-12T22:54:09.320 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=10 2024-05-12T22:54:09.320 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:09.327 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:09.327 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:09.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:09.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:09.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:09.418 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:09.418 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:09.482 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:09.482 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:09.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:09.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:09.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 10 -lt 100 ] 2024-05-12T22:54:09.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 10 + 1 2024-05-12T22:54:09.532 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=11 2024-05-12T22:54:09.532 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:09.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:09.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:09.550 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:09.550 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:09.550 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:09.939 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:09.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.036 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:10.037 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:10.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 11 -lt 100 ] 2024-05-12T22:54:10.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 11 + 1 2024-05-12T22:54:10.079 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=12 2024-05-12T22:54:10.079 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:10.087 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:10.087 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.090 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:10.090 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:10.090 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:10.214 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:10.230 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.328 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:10.328 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:10.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 12 -lt 100 ] 2024-05-12T22:54:10.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 12 + 1 2024-05-12T22:54:10.345 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=13 2024-05-12T22:54:10.345 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:10.352 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:10.352 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.355 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:10.355 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:10.355 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:10.739 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:10.755 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.797 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:10.797 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:10.805 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.805 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:10.805 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 13 -lt 100 ] 2024-05-12T22:54:10.805 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 13 + 1 2024-05-12T22:54:10.831 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=14 2024-05-12T22:54:10.832 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:10.847 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:10.847 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:10.849 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:10.849 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:10.850 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:11.230 INFO:tasks.workunit.client.0.smithi040.stderr:+ + getfacl d1 2024-05-12T22:54:11.231 INFO:tasks.workunit.client.0.smithi040.stderr:grep -c nobody:rw 2024-05-12T22:54:11.339 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:11.340 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:11.357 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:11.357 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:11.357 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 14 -lt 100 ] 2024-05-12T22:54:11.357 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 14 + 1 2024-05-12T22:54:11.396 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=15 2024-05-12T22:54:11.396 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:11.406 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:11.406 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:11.407 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:11.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:11.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:11.831 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:11.846 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:11.863 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:11.863 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:11.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:11.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:11.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 15 -lt 100 ] 2024-05-12T22:54:11.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 15 + 1 2024-05-12T22:54:11.874 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=16 2024-05-12T22:54:11.874 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:11.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:11.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:11.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:11.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:11.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:11.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:11.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.029 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.029 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.029 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 16 -lt 100 ] 2024-05-12T22:54:12.029 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 16 + 1 2024-05-12T22:54:12.033 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=17 2024-05-12T22:54:12.033 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.038 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.038 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.040 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.040 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.040 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.131 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.131 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.151 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.151 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.155 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.155 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.155 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 17 -lt 100 ] 2024-05-12T22:54:12.156 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 17 + 1 2024-05-12T22:54:12.159 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=18 2024-05-12T22:54:12.159 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.164 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.164 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.166 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.166 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.166 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.267 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.267 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.272 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.272 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.272 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 18 -lt 100 ] 2024-05-12T22:54:12.272 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 18 + 1 2024-05-12T22:54:12.277 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=19 2024-05-12T22:54:12.277 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.282 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.282 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.284 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.284 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.284 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.416 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.416 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 19 -lt 100 ] 2024-05-12T22:54:12.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 19 + 1 2024-05-12T22:54:12.427 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=20 2024-05-12T22:54:12.427 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.433 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.433 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.435 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.435 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.435 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.519 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.519 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.532 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.533 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.537 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.537 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.537 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 20 -lt 100 ] 2024-05-12T22:54:12.537 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 20 + 1 2024-05-12T22:54:12.542 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=21 2024-05-12T22:54:12.542 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.548 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.549 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.549 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.624 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.652 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.652 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.657 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.657 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.657 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 21 -lt 100 ] 2024-05-12T22:54:12.657 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 21 + 1 2024-05-12T22:54:12.660 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=22 2024-05-12T22:54:12.660 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.665 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.665 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.667 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.668 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.668 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.767 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.767 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.778 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.778 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 22 -lt 100 ] 2024-05-12T22:54:12.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 22 + 1 2024-05-12T22:54:12.785 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=23 2024-05-12T22:54:12.785 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.791 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.791 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.793 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.793 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.793 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:12.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.890 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.906 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:12.906 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:12.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:12.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 23 -lt 100 ] 2024-05-12T22:54:12.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 23 + 1 2024-05-12T22:54:12.914 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=24 2024-05-12T22:54:12.914 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:12.920 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:12.920 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:12.922 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:12.922 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:12.922 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.000 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:13.000 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:13.017 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.017 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 24 -lt 100 ] 2024-05-12T22:54:13.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 24 + 1 2024-05-12T22:54:13.025 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=25 2024-05-12T22:54:13.025 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.031 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.031 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.031 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.107 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.107 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.122 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.122 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 25 -lt 100 ] 2024-05-12T22:54:13.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 25 + 1 2024-05-12T22:54:13.130 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=26 2024-05-12T22:54:13.130 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.133 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.133 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.134 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.134 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.135 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.210 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.210 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.231 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.231 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 26 -lt 100 ] 2024-05-12T22:54:13.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 26 + 1 2024-05-12T22:54:13.241 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=27 2024-05-12T22:54:13.241 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.244 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.244 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.319 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.319 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.339 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.340 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.344 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.344 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.344 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 27 -lt 100 ] 2024-05-12T22:54:13.344 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 27 + 1 2024-05-12T22:54:13.347 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=28 2024-05-12T22:54:13.347 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.351 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.351 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.352 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.352 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.353 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.431 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.431 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.444 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.444 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 28 -lt 100 ] 2024-05-12T22:54:13.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 28 + 1 2024-05-12T22:54:13.452 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=29 2024-05-12T22:54:13.452 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.456 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.456 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.457 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.457 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.457 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.556 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.556 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.567 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.568 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.572 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.572 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.572 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 29 -lt 100 ] 2024-05-12T22:54:13.572 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 29 + 1 2024-05-12T22:54:13.575 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=30 2024-05-12T22:54:13.576 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.579 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.579 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.581 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.581 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.581 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.659 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.659 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.673 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.673 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.677 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.677 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.677 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 30 -lt 100 ] 2024-05-12T22:54:13.677 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 30 + 1 2024-05-12T22:54:13.680 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=31 2024-05-12T22:54:13.681 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.684 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.684 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.685 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.685 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.686 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.763 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.763 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.775 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.775 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.779 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.779 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.779 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 31 -lt 100 ] 2024-05-12T22:54:13.779 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 31 + 1 2024-05-12T22:54:13.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=32 2024-05-12T22:54:13.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.786 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.786 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.787 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.788 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.788 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.863 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.863 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.875 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.875 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.879 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.879 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 32 -lt 100 ] 2024-05-12T22:54:13.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 32 + 1 2024-05-12T22:54:13.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=33 2024-05-12T22:54:13.883 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.886 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.886 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.887 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.887 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.887 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:13.962 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.962 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:13.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:13.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:13.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 33 -lt 100 ] 2024-05-12T22:54:13.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 33 + 1 2024-05-12T22:54:13.984 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=34 2024-05-12T22:54:13.984 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:13.987 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:13.987 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:13.989 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:13.989 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:13.989 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.061 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.062 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.073 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.073 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.077 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 34 -lt 100 ] 2024-05-12T22:54:14.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 34 + 1 2024-05-12T22:54:14.081 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=35 2024-05-12T22:54:14.081 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.084 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.084 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.086 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.086 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.086 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.164 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.165 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.179 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.179 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.183 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.183 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.183 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 35 -lt 100 ] 2024-05-12T22:54:14.183 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 35 + 1 2024-05-12T22:54:14.187 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=36 2024-05-12T22:54:14.187 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.190 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.190 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.191 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.191 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.191 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.264 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.265 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.278 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.278 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.281 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.281 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.281 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 36 -lt 100 ] 2024-05-12T22:54:14.281 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 36 + 1 2024-05-12T22:54:14.285 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=37 2024-05-12T22:54:14.285 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.288 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.288 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.290 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.290 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.290 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.362 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.362 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.380 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.380 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.380 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 37 -lt 100 ] 2024-05-12T22:54:14.380 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 37 + 1 2024-05-12T22:54:14.384 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=38 2024-05-12T22:54:14.384 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.387 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.387 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.389 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.389 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.389 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.470 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.470 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.483 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.484 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 38 -lt 100 ] 2024-05-12T22:54:14.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 38 + 1 2024-05-12T22:54:14.492 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=39 2024-05-12T22:54:14.493 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.496 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.496 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.497 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.497 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.498 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.570 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.570 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.582 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.582 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.586 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.587 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.587 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 39 -lt 100 ] 2024-05-12T22:54:14.587 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 39 + 1 2024-05-12T22:54:14.591 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=40 2024-05-12T22:54:14.591 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.594 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.594 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.596 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.596 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.596 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.668 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.668 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.690 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.690 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.694 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.694 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.694 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 40 -lt 100 ] 2024-05-12T22:54:14.694 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 40 + 1 2024-05-12T22:54:14.699 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=41 2024-05-12T22:54:14.699 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.702 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.702 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.703 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.703 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.703 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.774 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.774 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.788 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.788 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.792 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.792 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.792 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 41 -lt 100 ] 2024-05-12T22:54:14.792 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 41 + 1 2024-05-12T22:54:14.796 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=42 2024-05-12T22:54:14.796 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.799 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.799 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.800 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.800 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.800 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.885 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.886 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.907 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:14.907 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:14.911 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.911 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:14.911 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 42 -lt 100 ] 2024-05-12T22:54:14.911 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 42 + 1 2024-05-12T22:54:14.914 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=43 2024-05-12T22:54:14.914 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:14.918 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.918 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:14.919 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:14.919 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:14.919 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:14.996 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:14.996 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.011 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.012 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.016 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.016 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.016 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 43 -lt 100 ] 2024-05-12T22:54:15.016 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 43 + 1 2024-05-12T22:54:15.019 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=44 2024-05-12T22:54:15.019 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.022 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.023 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.096 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.096 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.110 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.110 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 44 -lt 100 ] 2024-05-12T22:54:15.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 44 + 1 2024-05-12T22:54:15.118 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=45 2024-05-12T22:54:15.118 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.121 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.121 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.123 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.123 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.123 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.196 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.196 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.209 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.209 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.212 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 45 -lt 100 ] 2024-05-12T22:54:15.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 45 + 1 2024-05-12T22:54:15.217 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=46 2024-05-12T22:54:15.217 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.220 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.220 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.221 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.221 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.222 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.303 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.303 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.324 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.324 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.328 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.328 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.328 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 46 -lt 100 ] 2024-05-12T22:54:15.329 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 46 + 1 2024-05-12T22:54:15.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=47 2024-05-12T22:54:15.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.335 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:15.335 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:15.336 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.336 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.336 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.413 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:15.413 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:15.425 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.425 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.429 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.430 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.430 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 47 -lt 100 ] 2024-05-12T22:54:15.430 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 47 + 1 2024-05-12T22:54:15.434 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=48 2024-05-12T22:54:15.434 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.439 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.439 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.439 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.512 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.512 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.532 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 48 -lt 100 ] 2024-05-12T22:54:15.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 48 + 1 2024-05-12T22:54:15.540 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=49 2024-05-12T22:54:15.540 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.632 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.632 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.636 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.636 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.636 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 49 -lt 100 ] 2024-05-12T22:54:15.637 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 49 + 1 2024-05-12T22:54:15.640 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=50 2024-05-12T22:54:15.640 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.644 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.645 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.646 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.646 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.646 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.728 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.729 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.742 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.742 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.746 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.746 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.747 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 50 -lt 100 ] 2024-05-12T22:54:15.747 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 50 + 1 2024-05-12T22:54:15.750 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=51 2024-05-12T22:54:15.750 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.755 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.755 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.756 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.829 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.829 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.843 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.843 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.848 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.848 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.848 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 51 -lt 100 ] 2024-05-12T22:54:15.849 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 51 + 1 2024-05-12T22:54:15.853 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=52 2024-05-12T22:54:15.853 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:15.929 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.930 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.942 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:15.943 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:15.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.947 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:15.947 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 52 -lt 100 ] 2024-05-12T22:54:15.947 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 52 + 1 2024-05-12T22:54:15.951 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=53 2024-05-12T22:54:15.952 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:15.956 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:15.956 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:15.958 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:15.958 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:15.958 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.031 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.031 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.044 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.044 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.049 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.049 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.049 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 53 -lt 100 ] 2024-05-12T22:54:16.049 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 53 + 1 2024-05-12T22:54:16.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=54 2024-05-12T22:54:16.052 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.057 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.057 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.059 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.059 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.059 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.152 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.152 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.171 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.172 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.175 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.175 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.175 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 54 -lt 100 ] 2024-05-12T22:54:16.176 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 54 + 1 2024-05-12T22:54:16.179 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=55 2024-05-12T22:54:16.179 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.186 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.186 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.187 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.187 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.187 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.265 INFO:tasks.workunit.client.0.smithi040.stderr:+ + getfacl d1 2024-05-12T22:54:16.265 INFO:tasks.workunit.client.0.smithi040.stderr:grep -c nobody:rw 2024-05-12T22:54:16.321 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.321 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 55 -lt 100 ] 2024-05-12T22:54:16.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 55 + 1 2024-05-12T22:54:16.329 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=56 2024-05-12T22:54:16.329 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.333 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.333 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.335 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.335 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.335 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.408 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.423 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.423 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.428 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.428 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.428 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 56 -lt 100 ] 2024-05-12T22:54:16.428 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 56 + 1 2024-05-12T22:54:16.432 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=57 2024-05-12T22:54:16.432 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.515 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:16.515 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:16.531 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.532 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 57 -lt 100 ] 2024-05-12T22:54:16.536 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 57 + 1 2024-05-12T22:54:16.539 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=58 2024-05-12T22:54:16.540 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.546 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.643 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.643 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.647 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.648 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.648 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 58 -lt 100 ] 2024-05-12T22:54:16.648 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 58 + 1 2024-05-12T22:54:16.652 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=59 2024-05-12T22:54:16.652 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.658 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.658 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.659 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.660 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.660 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.737 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.745 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.765 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.765 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 59 -lt 100 ] 2024-05-12T22:54:16.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 59 + 1 2024-05-12T22:54:16.777 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=60 2024-05-12T22:54:16.777 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.781 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.781 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.862 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.863 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:16.884 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.884 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:16.884 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 60 -lt 100 ] 2024-05-12T22:54:16.884 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 60 + 1 2024-05-12T22:54:16.888 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=61 2024-05-12T22:54:16.888 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:16.893 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.893 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.895 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:16.895 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:16.895 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:16.982 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:16.982 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:16.996 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:16.996 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.004 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.004 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.004 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 61 -lt 100 ] 2024-05-12T22:54:17.004 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 61 + 1 2024-05-12T22:54:17.008 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=62 2024-05-12T22:54:17.008 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.013 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.014 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.015 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.015 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.015 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.099 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.099 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.115 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.115 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.119 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.119 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.119 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 62 -lt 100 ] 2024-05-12T22:54:17.119 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 62 + 1 2024-05-12T22:54:17.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=63 2024-05-12T22:54:17.126 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.127 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.127 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.128 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.129 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.129 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.214 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.231 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.231 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.235 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 63 -lt 100 ] 2024-05-12T22:54:17.236 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 63 + 1 2024-05-12T22:54:17.239 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=64 2024-05-12T22:54:17.239 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.243 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.243 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.245 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.245 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.245 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.361 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.361 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.366 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.366 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.366 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 64 -lt 100 ] 2024-05-12T22:54:17.366 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 64 + 1 2024-05-12T22:54:17.369 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=65 2024-05-12T22:54:17.369 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.374 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.375 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.472 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.472 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.489 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.489 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 65 -lt 100 ] 2024-05-12T22:54:17.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 65 + 1 2024-05-12T22:54:17.498 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=66 2024-05-12T22:54:17.498 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.503 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.503 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.592 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.592 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.616 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.616 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 66 -lt 100 ] 2024-05-12T22:54:17.620 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 66 + 1 2024-05-12T22:54:17.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=67 2024-05-12T22:54:17.624 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.627 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.627 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.629 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.629 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.629 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.703 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.703 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.723 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.723 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.727 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.727 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.727 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 67 -lt 100 ] 2024-05-12T22:54:17.727 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 67 + 1 2024-05-12T22:54:17.730 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=68 2024-05-12T22:54:17.730 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.734 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.734 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.735 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.736 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.736 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.816 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.816 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.838 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.838 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.842 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.842 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.842 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 68 -lt 100 ] 2024-05-12T22:54:17.842 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 68 + 1 2024-05-12T22:54:17.853 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=69 2024-05-12T22:54:17.853 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.857 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.857 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:17.932 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.932 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:17.946 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:17.950 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.950 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:17.950 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 69 -lt 100 ] 2024-05-12T22:54:17.950 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 69 + 1 2024-05-12T22:54:17.955 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=70 2024-05-12T22:54:17.955 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:17.959 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:17.959 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:17.960 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:17.961 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:17.961 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.042 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.042 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.063 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.064 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.067 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.068 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.068 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 70 -lt 100 ] 2024-05-12T22:54:18.068 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 70 + 1 2024-05-12T22:54:18.072 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=71 2024-05-12T22:54:18.072 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.076 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.076 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.078 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.160 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.161 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.181 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.181 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 71 -lt 100 ] 2024-05-12T22:54:18.185 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 71 + 1 2024-05-12T22:54:18.189 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=72 2024-05-12T22:54:18.189 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.193 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:18.193 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:18.195 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.195 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.195 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.294 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.294 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.317 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.317 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.322 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.322 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.322 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 72 -lt 100 ] 2024-05-12T22:54:18.322 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 72 + 1 2024-05-12T22:54:18.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=73 2024-05-12T22:54:18.325 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.331 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.331 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.332 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.413 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.413 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.431 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.431 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 73 -lt 100 ] 2024-05-12T22:54:18.436 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 73 + 1 2024-05-12T22:54:18.439 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=74 2024-05-12T22:54:18.440 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.445 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.445 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.447 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.447 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.447 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.547 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.616 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.616 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.622 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 74 -lt 100 ] 2024-05-12T22:54:18.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 74 + 1 2024-05-12T22:54:18.627 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=75 2024-05-12T22:54:18.627 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.632 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:18.632 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:18.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.738 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.745 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.760 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.760 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.760 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 75 -lt 100 ] 2024-05-12T22:54:18.760 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 75 + 1 2024-05-12T22:54:18.764 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=76 2024-05-12T22:54:18.764 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.768 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.768 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.770 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.770 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.770 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.847 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.847 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.864 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.864 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 76 -lt 100 ] 2024-05-12T22:54:18.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 76 + 1 2024-05-12T22:54:18.872 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=77 2024-05-12T22:54:18.872 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.877 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.877 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.879 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.879 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.879 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:18.957 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.957 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:18.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:18.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:18.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 77 -lt 100 ] 2024-05-12T22:54:18.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 77 + 1 2024-05-12T22:54:18.982 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=78 2024-05-12T22:54:18.982 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:18.986 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:18.986 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:18.991 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:18.991 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:18.991 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.084 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.085 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.106 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.106 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.110 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.110 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.110 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 78 -lt 100 ] 2024-05-12T22:54:19.111 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 78 + 1 2024-05-12T22:54:19.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=79 2024-05-12T22:54:19.114 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.118 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.118 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.120 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.120 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.120 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.199 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.200 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.213 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.217 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.217 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.218 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 79 -lt 100 ] 2024-05-12T22:54:19.218 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 79 + 1 2024-05-12T22:54:19.222 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=80 2024-05-12T22:54:19.222 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.226 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.226 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.228 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.228 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.228 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.304 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.304 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.321 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.322 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 80 -lt 100 ] 2024-05-12T22:54:19.330 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 80 + 1 2024-05-12T22:54:19.334 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=81 2024-05-12T22:54:19.334 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.340 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.340 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.341 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.342 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.415 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.430 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.430 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 81 -lt 100 ] 2024-05-12T22:54:19.438 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 81 + 1 2024-05-12T22:54:19.442 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=82 2024-05-12T22:54:19.443 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.448 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.449 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.450 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.450 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.523 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.523 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.539 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.539 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 82 -lt 100 ] 2024-05-12T22:54:19.545 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 82 + 1 2024-05-12T22:54:19.548 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=83 2024-05-12T22:54:19.549 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.554 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.554 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.556 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.556 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.556 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.630 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.631 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.647 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.647 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.653 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.653 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.653 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 83 -lt 100 ] 2024-05-12T22:54:19.653 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 83 + 1 2024-05-12T22:54:19.658 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=84 2024-05-12T22:54:19.658 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.663 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.663 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.664 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.665 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.665 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.740 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.740 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.763 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.764 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.769 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.769 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.769 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 84 -lt 100 ] 2024-05-12T22:54:19.769 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 84 + 1 2024-05-12T22:54:19.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=85 2024-05-12T22:54:19.773 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.778 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.778 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:19.783 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.856 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.856 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:19.880 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:19.885 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.885 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:19.885 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 85 -lt 100 ] 2024-05-12T22:54:19.886 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 85 + 1 2024-05-12T22:54:19.889 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=86 2024-05-12T22:54:19.889 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:19.894 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.894 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:19.896 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:19.896 INFO:tasks.workunit.client.0.smithi040.stderr:+ + sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:19.896 INFO:tasks.workunit.client.0.smithi040.stderr:echo 3 2024-05-12T22:54:19.978 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:19.979 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.024 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 86 -lt 100 ] 2024-05-12T22:54:20.030 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 86 + 1 2024-05-12T22:54:20.033 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=87 2024-05-12T22:54:20.033 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.038 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.038 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.039 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.040 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.040 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.113 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.113 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.130 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.130 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.135 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.135 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.136 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 87 -lt 100 ] 2024-05-12T22:54:20.136 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 87 + 1 2024-05-12T22:54:20.139 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=88 2024-05-12T22:54:20.139 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.144 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.144 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.145 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.145 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.145 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.232 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.233 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.247 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.247 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.253 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.253 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.253 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 88 -lt 100 ] 2024-05-12T22:54:20.253 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 88 + 1 2024-05-12T22:54:20.257 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=89 2024-05-12T22:54:20.257 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.262 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.262 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.263 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.263 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.263 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.349 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.349 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.364 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.364 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.369 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.370 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.370 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 89 -lt 100 ] 2024-05-12T22:54:20.370 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 89 + 1 2024-05-12T22:54:20.373 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=90 2024-05-12T22:54:20.373 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.377 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.378 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.463 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.463 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.479 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.479 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.485 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.485 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.485 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 90 -lt 100 ] 2024-05-12T22:54:20.485 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 90 + 1 2024-05-12T22:54:20.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=91 2024-05-12T22:54:20.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.493 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.493 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.494 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.495 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.579 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.579 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.598 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.598 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.601 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.601 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.601 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 91 -lt 100 ] 2024-05-12T22:54:20.601 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 91 + 1 2024-05-12T22:54:20.612 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=92 2024-05-12T22:54:20.612 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.623 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.624 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.625 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.625 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.625 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.719 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.719 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.738 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.739 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.743 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.743 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.743 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 92 -lt 100 ] 2024-05-12T22:54:20.743 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 92 + 1 2024-05-12T22:54:20.748 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=93 2024-05-12T22:54:20.748 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.753 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.753 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.754 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.830 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.830 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.846 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.846 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.850 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.850 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.851 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 93 -lt 100 ] 2024-05-12T22:54:20.851 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 93 + 1 2024-05-12T22:54:20.854 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=94 2024-05-12T22:54:20.854 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.858 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.859 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.860 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.860 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:20.948 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.948 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.963 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:20.963 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:20.967 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.967 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:20.967 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 94 -lt 100 ] 2024-05-12T22:54:20.968 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 94 + 1 2024-05-12T22:54:20.971 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=95 2024-05-12T22:54:20.971 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:20.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:20.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:20.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:20.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:20.977 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.058 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.058 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.071 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 95 -lt 100 ] 2024-05-12T22:54:21.075 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 95 + 1 2024-05-12T22:54:21.079 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=96 2024-05-12T22:54:21.079 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.083 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.083 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.085 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:21.085 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:21.085 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.186 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.186 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.246 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.250 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.250 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.250 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 96 -lt 100 ] 2024-05-12T22:54:21.250 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 96 + 1 2024-05-12T22:54:21.254 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=97 2024-05-12T22:54:21.254 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.258 INFO:tasks.workunit.client.0.smithi040.stderr:+ + grep -c nobody:rw 2024-05-12T22:54:21.258 INFO:tasks.workunit.client.0.smithi040.stderr:getfacl d1 2024-05-12T22:54:21.260 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:21.260 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:21.260 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.343 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.343 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.364 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.364 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.368 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.368 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.368 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 97 -lt 100 ] 2024-05-12T22:54:21.368 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 97 + 1 2024-05-12T22:54:21.371 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=98 2024-05-12T22:54:21.371 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.374 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.374 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:21.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:21.376 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.488 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.505 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.510 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.510 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.510 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 98 -lt 100 ] 2024-05-12T22:54:21.510 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 98 + 1 2024-05-12T22:54:21.513 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=99 2024-05-12T22:54:21.513 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.517 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.517 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.519 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:21.519 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:21.519 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.612 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.612 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.630 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.630 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 99 -lt 100 ] 2024-05-12T22:54:21.634 INFO:tasks.workunit.client.0.smithi040.stderr:+ expr 99 + 1 2024-05-12T22:54:21.639 INFO:tasks.workunit.client.0.smithi040.stderr:+ c=100 2024-05-12T22:54:21.639 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.642 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.642 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.644 INFO:tasks.workunit.client.0.smithi040.stderr:+ c1=2 2024-05-12T22:54:21.644 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo 3 2024-05-12T22:54:21.644 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-05-12T22:54:21.732 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfacl d1 2024-05-12T22:54:21.736 INFO:tasks.workunit.client.0.smithi040.stderr:+ grep -c nobody:rw 2024-05-12T22:54:21.762 INFO:tasks.workunit.client.0.smithi040.stderr:+ c2=2 2024-05-12T22:54:21.762 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.766 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.767 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 2 -ne 2 ] 2024-05-12T22:54:21.767 INFO:tasks.workunit.client.0.smithi040.stderr:+ [ 100 -lt 100 ] 2024-05-12T22:54:21.767 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir d1 2024-05-12T22:54:21.771 INFO:tasks.workunit.client.0.smithi040.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-05-12T22:54:21.780 INFO:tasks.workunit.client.0.smithi040.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-05-12T22:54:21.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-05-12T22:54:21.782 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfattr -n system.posix_acl_access d1 2024-05-12T22:54:21.787 INFO:tasks.workunit.client.0.smithi040.stderr:d1: system.posix_acl_access: No such attribute 2024-05-12T22:54:21.787 INFO:tasks.workunit.client.0.smithi040.stderr:+ return 0 2024-05-12T22:54:21.787 INFO:tasks.workunit.client.0.smithi040.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-05-12T22:54:21.787 INFO:tasks.workunit.client.0.smithi040.stderr:+ getfattr -n system.posix_acl_default . 2024-05-12T22:54:21.788 INFO:tasks.workunit.client.0.smithi040.stderr:.: system.posix_acl_default: No such attribute 2024-05-12T22:54:21.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ return 0 2024-05-12T22:54:21.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir d1 2024-05-12T22:54:21.823 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd .. 2024-05-12T22:54:21.823 INFO:tasks.workunit.client.0.smithi040.stderr:+ rmdir testdir 2024-05-12T22:54:21.830 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo OK 2024-05-12T22:54:21.831 INFO:tasks.workunit.client.0.smithi040.stdout:OK 2024-05-12T22:54:21.832 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T22:54:21.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T22:54:21.977 INFO:tasks.workunit:Stopping ['fs/misc/acl.sh'] on client.0... 2024-05-12T22:54:21.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-12T22:54:22.221 DEBUG:teuthology.parallel:result is None 2024-05-12T22:54:22.222 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c50db29d375ad9ca1a200449f9347b89e25fb278 2024-05-12T22:54:22.290 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-12T22:54:32.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:54:32.171 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:55:02.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:55:02.288 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:55:32.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:55:32.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:55:33.061 INFO:tasks.workunit.client.0.smithi040.stderr:Updating files: 95% (11939/12534) Updating files: 96% (12033/12534) Updating files: 97% (12158/12534) Updating files: 98% (12284/12534) Updating files: 99% (12409/12534) Updating files: 100% (12534/12534) Updating files: 100% (12534/12534), done. 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to 'c50db29d375ad9ca1a200449f9347b89e25fb278'. 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.321 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:55:33.322 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at c50db29d375 Merge pull request #57417 from zdover23/wip-doc-2024-05-12-backport-57415-to-squid 2024-05-12T22:55:33.327 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-12T22:55:33.357 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-12T22:55:33.359 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:55:33.359 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-12T22:55:34.289 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-12T22:55:34.403 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-12T22:55:34.463 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:55:34.465 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:55:34.465 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-12T22:55:34.514 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:55:34.713 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:55:34.713 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-12T22:55:34.775 INFO:tasks.workunit:Running workunits matching fs/misc/chmod.sh on client.0... 2024-05-12T22:55:34.776 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-05-12T22:55:34.777 DEBUG:teuthology.orchestra.run.smithi040:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c50db29d375ad9ca1a200449f9347b89e25fb278 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-05-12T22:55:34.868 INFO:tasks.workunit.client.0.smithi040.stderr:+ set -e 2024-05-12T22:55:34.869 INFO:tasks.workunit.client.0.smithi040.stderr:+ file=test_chmod.34681 2024-05-12T22:55:34.871 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo foo 2024-05-12T22:55:34.897 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.897 INFO:tasks.workunit.client.0.smithi040.stderr:+ chmod 400 test_chmod.34681 2024-05-12T22:55:34.904 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.904 INFO:tasks.workunit.client.0.smithi040.stderr:+ check_perms test_chmod.34681 -r-------- 2024-05-12T22:55:34.904 INFO:tasks.workunit.client.0.smithi040.stderr:+ file=test_chmod.34681 2024-05-12T22:55:34.904 INFO:tasks.workunit.client.0.smithi040.stderr:+ ls -la test_chmod.34681 2024-05-12T22:55:34.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ r=-r-------- 1 ubuntu ubuntu 4 May 12 22:55 test_chmod.34681 2024-05-12T22:55:34.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ perms=-r-------- 2024-05-12T22:55:34.911 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo -r-------- 1 ubuntu ubuntu 4 May 12 22:55 test_chmod.34681 2024-05-12T22:55:34.917 INFO:tasks.workunit.client.0.smithi040.stderr:+ awk {print $1} 2024-05-12T22:55:34.968 INFO:tasks.workunit.client.0.smithi040.stderr:+ test -r-------- != -r-------- 2024-05-12T22:55:34.968 INFO:tasks.workunit.client.0.smithi040.stderr:+ set +e 2024-05-12T22:55:34.969 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: 40: cannot create test_chmod.34681: Permission denied 2024-05-12T22:55:34.969 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 2 = 0 2024-05-12T22:55:34.969 INFO:tasks.workunit.client.0.smithi040.stderr:+ set -e 2024-05-12T22:55:34.969 INFO:tasks.workunit.client.0.smithi040.stderr:+ chmod 600 test_chmod.34681 2024-05-12T22:55:34.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo bar 2024-05-12T22:55:34.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ check_perms test_chmod.34681 -rw------- 2024-05-12T22:55:34.972 INFO:tasks.workunit.client.0.smithi040.stderr:+ file=test_chmod.34681 2024-05-12T22:55:34.973 INFO:tasks.workunit.client.0.smithi040.stderr:+ ls -la test_chmod.34681 2024-05-12T22:55:34.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ r=-rw------- 1 ubuntu ubuntu 8 May 12 22:55 test_chmod.34681 2024-05-12T22:55:34.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.975 INFO:tasks.workunit.client.0.smithi040.stderr:+ perms=-rw------- 2024-05-12T22:55:34.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo -rw------- 1 ubuntu ubuntu 8 May 12 22:55 test_chmod.34681 2024-05-12T22:55:34.976 INFO:tasks.workunit.client.0.smithi040.stderr:+ awk {print $1} 2024-05-12T22:55:34.977 INFO:tasks.workunit.client.0.smithi040.stderr:+ test -rw------- != -rw------- 2024-05-12T22:55:34.978 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo foo 2024-05-12T22:55:34.978 INFO:tasks.workunit.client.0.smithi040.stderr:+ test 0 != 0 2024-05-12T22:55:34.979 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T22:55:34.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T22:55:35.015 INFO:tasks.workunit:Stopping ['fs/misc/chmod.sh'] on client.0... 2024-05-12T22:55:35.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-12T22:55:35.360 DEBUG:teuthology.parallel:result is None 2024-05-12T22:55:35.360 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c50db29d375ad9ca1a200449f9347b89e25fb278 2024-05-12T22:55:35.367 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-12T22:56:02.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:56:02.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:56:32.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:56:32.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:56:45.856 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to 'c50db29d375ad9ca1a200449f9347b89e25fb278'. 2024-05-12T22:56:45.856 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.856 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-05-12T22:56:45.857 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at c50db29d375 Merge pull request #57417 from zdover23/wip-doc-2024-05-12-backport-57415-to-squid 2024-05-12T22:56:45.862 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-12T22:56:45.869 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-12T22:56:45.872 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:56:45.872 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-12T22:56:45.932 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-12T22:56:45.994 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-12T22:56:46.042 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-12T22:56:46.044 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:56:46.044 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-12T22:56:46.088 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-12T22:56:46.092 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:56:46.092 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-12T22:56:46.141 INFO:tasks.workunit:Running workunits matching fs/misc/dac_override.sh on client.0... 2024-05-12T22:56:46.143 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-05-12T22:56:46.143 DEBUG:teuthology.orchestra.run.smithi040:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c50db29d375ad9ca1a200449f9347b89e25fb278 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-05-12T22:56:46.200 INFO:tasks.workunit.client.0.smithi040.stderr:+ set -e 2024-05-12T22:56:46.200 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir -p testdir 2024-05-12T22:56:46.204 INFO:tasks.workunit.client.0.smithi040.stderr:+ file=test_chmod.34785 2024-05-12T22:56:46.206 INFO:tasks.workunit.client.0.smithi040.stderr:+ echo foo 2024-05-12T22:56:46.206 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo chmod 600 testdir 2024-05-12T22:56:46.216 INFO:tasks.workunit.client.0.smithi040.stderr:+ expect_failure cat testdir/test_chmod.34785 2024-05-12T22:56:46.216 INFO:tasks.workunit.client.0.smithi040.stderr:+ cat testdir/test_chmod.34785 2024-05-12T22:56:46.226 INFO:tasks.workunit.client.0.smithi040.stderr:cat: testdir/test_chmod.34785: Permission denied 2024-05-12T22:56:46.226 INFO:tasks.workunit.client.0.smithi040.stderr:+ return 0 2024-05-12T22:56:46.226 INFO:tasks.workunit.client.0.smithi040.stderr:+ sudo cat testdir/test_chmod.34785 2024-05-12T22:56:46.233 INFO:tasks.workunit.client.0.smithi040.stdout:foo 2024-05-12T22:56:46.235 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-12T22:56:46.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-12T22:56:46.318 INFO:tasks.workunit:Stopping ['fs/misc/dac_override.sh'] on client.0... 2024-05-12T22:56:46.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-12T22:56:46.664 DEBUG:teuthology.parallel:result is None 2024-05-12T22:56:46.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T22:56:46.688 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-12T22:56:46.688 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-12T22:56:46.698 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-12T22:56:46.698 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:56:46.698 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T22:56:46.735 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:56:46.736 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T22:56:46.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:56:47.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 Processor -- start 2024-05-12T22:56:47.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 -- start start 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f987c0b5d70 0x7f987c148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f987c0b2c50 0x7f987c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c0b6150 con 0x7f987c13f050 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f987c06f990 con 0x7f987c0b2c50 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f988153d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f987c0708b0 con 0x7f987c0b5d70 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f987c0b2c50 0x7f987c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f987c0b2c50 0x7f987c148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59172/0 (socket says 172.21.15.40:59172) 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 -- 172.21.15.40:0/4165123862 learned_addr learned my addr 172.21.15.40:0/4165123862 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:47.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987affd640 1 --2- 172.21.15.40:0/4165123862 >> v2:172.21.15.47:3300/0 conn(0x7f987c0b5d70 0x7f987c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 -- 172.21.15.40:0/4165123862 >> v2:172.21.15.47:3300/0 conn(0x7f987c0b5d70 msgr2=0x7f987c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:47.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 --2- 172.21.15.40:0/4165123862 >> v2:172.21.15.47:3300/0 conn(0x7f987c0b5d70 0x7f987c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:47.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 -- 172.21.15.40:0/4165123862 >> v1:172.21.15.47:6789/0 conn(0x7f987c13f050 legacy=0x7f987c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:47.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.828+0000 7f987a7fc640 1 -- 172.21.15.40:0/4165123862 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c06f620 con 0x7f987c0b2c50 2024-05-12T22:56:47.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f987a7fc640 1 --2- 172.21.15.40:0/4165123862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b2c50 0x7f987c148ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f987c06df50 tx=0x7f986401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59bccb758ce2d15 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:47.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f9879ffb640 1 -- 172.21.15.40:0/4165123862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640aa610 con 0x7f987c0b2c50 2024-05-12T22:56:47.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f9879ffb640 1 -- 172.21.15.40:0/4165123862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98640af070 con 0x7f987c0b2c50 2024-05-12T22:56:47.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f9879ffb640 1 -- 172.21.15.40:0/4165123862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640aa9d0 con 0x7f987c0b2c50 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 -- 172.21.15.40:0/4165123862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b2c50 msgr2=0x7f987c148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 --2- 172.21.15.40:0/4165123862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b2c50 0x7f987c148ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f987c06df50 tx=0x7f986401c490 comp rx=0 tx=0).stop 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 -- 172.21.15.40:0/4165123862 shutdown_connections 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 --2- 172.21.15.40:0/4165123862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b2c50 0x7f987c148ea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 --2- 172.21.15.40:0/4165123862 >> v2:172.21.15.47:3300/0 conn(0x7f987c0b5d70 0x7f987c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 -- 172.21.15.40:0/4165123862 >> 172.21.15.40:0/4165123862 conn(0x7f987c06b6c0 msgr2=0x7f987c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 -- 172.21.15.40:0/4165123862 shutdown_connections 2024-05-12T22:56:47.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.856+0000 7f988153d640 1 -- 172.21.15.40:0/4165123862 wait complete. 2024-05-12T22:56:47.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 Processor -- start 2024-05-12T22:56:47.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 -- start start 2024-05-12T22:56:47.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 0x7f987c1e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f987c13f050 0x7f987c1424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1526f0 con 0x7f987c0b5d70 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f987c152570 con 0x7f987c13f050 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f987c152870 con 0x7f987c0b2c50 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59188/0 (socket says 172.21.15.40:59188) 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 -- 172.21.15.40:0/1468639452 learned_addr learned my addr 172.21.15.40:0/1468639452 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987b7fe640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f987c13f050 0x7f987c1424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987affd640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 0x7f987c1e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 -- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 msgr2=0x7f987c1e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 0x7f987c1e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 -- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f987c13f050 msgr2=0x7f987c1424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f987c13f050 0x7f987c1424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:47.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 -- 172.21.15.40:0/1468639452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c1e31d0 con 0x7f987c0b5d70 2024-05-12T22:56:47.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987affd640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 0x7f987c1e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:56:47.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f987a7fc640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98640ac040 tx=0x7f986401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640bd5f0 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98640bd790 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.860+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c1e3bd0 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640bdb60 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c14f400 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c068330 con 0x7f987c0b5d70 2024-05-12T22:56:47.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98640b33f0 con 0x7f987c0b5d70 2024-05-12T22:56:47.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f98737fe640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 0x7f985c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:47.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9864120550 con 0x7f987c0b5d70 2024-05-12T22:56:47.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f987affd640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 0x7f985c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:47.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.864+0000 7f987affd640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 0x7f985c069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f986c009bb0 tx=0x7f986c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:47.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:47.868+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f987c1e31d0 con 0x7f987c0b5d70 2024-05-12T22:56:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.064+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f987c146790 con 0x7f987c0b5d70 2024-05-12T22:56:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.064+0000 7f98737fe640 1 -- 172.21.15.40:0/1468639452 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16783 (secure 0 0 0) 0x7f986411ee20 con 0x7f987c0b5d70 2024-05-12T22:56:48.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:48.068 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:53:16.686879+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 msgr2=0x7f985c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 0x7f985c069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f986c009bb0 tx=0x7f986c008040 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 msgr2=0x7f987c141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98640ac040 tx=0x7f986401acd0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 shutdown_connections 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f985c0678c0 0x7f985c069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f987c13f050 0x7f987c1424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0b5d70 0x7f987c141520 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 --2- 172.21.15.40:0/1468639452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f987c0b2c50 0x7f987c1e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 >> 172.21.15.40:0/1468639452 conn(0x7f987c06b6c0 msgr2=0x7f987c144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 shutdown_connections 2024-05-12T22:56:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.068+0000 7f988153d640 1 -- 172.21.15.40:0/1468639452 wait complete. 2024-05-12T22:56:48.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-12T22:52:33.297648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-12T22:52:33.880238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:56:48.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:56:48.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 Processor -- start 2024-05-12T22:56:48.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 -- start start 2024-05-12T22:56:48.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f411c142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411c0b6150 con 0x7f411c148860 2024-05-12T22:56:48.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411c0b4e70 con 0x7f411c0b5d70 2024-05-12T22:56:48.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4122bd9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f411c142c40 con 0x7f411c1422a0 2024-05-12T22:56:48.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f411c148860 0x7f411c148cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59390/0 (socket says 172.21.15.40:59390) 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 -- 172.21.15.40:0/3817824630 learned_addr learned my addr 172.21.15.40:0/3817824630 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411bfff640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f411c142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225453182 0 0) 0x7f411c0b6150 con 0x7f411c148860 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4104003530 con 0x7f411c148860 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250203565 0 0) 0x7f411c0b4e70 con 0x7f411c0b5d70 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f411c0b6150 con 0x7f411c0b5d70 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2013276368 0 0) 0x7f4104003530 con 0x7f411c148860 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 msgr2=0x7f411c142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f411c142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 >> v1:172.21.15.47:6789/0 conn(0x7f411c0b5d70 legacy=0x7f411c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c070a80 con 0x7f411c148860 2024-05-12T22:56:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f4114001a00 con 0x7f411c148860 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 >> v1:172.21.15.40:6789/0 conn(0x7f411c148860 legacy=0x7f411c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f4104003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004130 0x7f4104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104004d50 0x7f41040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f411c142c40 con 0x7f4104004d50 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f410400bc30 con 0x7f4104004130 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f410400be30 con 0x7f411c1422a0 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104004d50 0x7f41040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4120975640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f4104003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f411bfff640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004130 0x7f4104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 -- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 msgr2=0x7f4104003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c1422a0 0x7f4104003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 -- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004130 msgr2=0x7f4104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004130 0x7f4104004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.224+0000 7f4121176640 1 -- 172.21.15.40:0/3817824630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4104003530 con 0x7f4104004d50 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4121176640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104004d50 0x7f41040051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f411400a730 tx=0x7f411401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e4765ef2cea9c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411400a350 con 0x7f4104004d50 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41140a9020 con 0x7f4104004d50 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f411b7fe640 1 -- 172.21.15.40:0/3817824630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41140070d0 con 0x7f4104004d50 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- 172.21.15.40:0/3817824630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104004d50 msgr2=0x7f41040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 --2- 172.21.15.40:0/3817824630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104004d50 0x7f41040051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f411400a730 tx=0x7f411401d220 comp rx=0 tx=0).stop 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4121176640 1 -- 172.21.15.40:0/3817824630 reap_dead start 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- 172.21.15.40:0/3817824630 shutdown_connections 2024-05-12T22:56:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- 172.21.15.40:0/3817824630 >> 172.21.15.40:0/3817824630 conn(0x7f411c06b6c0 msgr2=0x7f411c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- 172.21.15.40:0/3817824630 shutdown_connections 2024-05-12T22:56:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- 172.21.15.40:0/3817824630 wait complete. 2024-05-12T22:56:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 Processor -- start 2024-05-12T22:56:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.228+0000 7f4122bd9640 1 -- start start 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004d50 0x7f411c146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c14fd80 0x7f411c1ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f411c151590 con 0x7f411c1de4e0 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f411c142a90 con 0x7f4104004d50 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f411c151710 con 0x7f411c14fd80 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59198/0 (socket says 172.21.15.40:59198) 2024-05-12T22:56:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 -- 172.21.15.40:0/2890612344 learned_addr learned my addr 172.21.15.40:0/2890612344 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f411bfff640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c14fd80 0x7f411c1ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4120975640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004d50 0x7f411c146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 -- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c14fd80 msgr2=0x7f411c1ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c14fd80 0x7f411c1ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 -- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004d50 msgr2=0x7f411c146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004d50 0x7f411c146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 -- 172.21.15.40:0/2890612344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c13d4e0 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4121176640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4114007040 tx=0x7f4104005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114001eb0 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41140072f0 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411c13d7c0 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41140076e0 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411c147b60 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411c1ddc80 con 0x7f411c1de4e0 2024-05-12T22:56:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4114007880 con 0x7f411c1de4e0 2024-05-12T22:56:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 0x7f4108069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f411411ff80 con 0x7f411c1de4e0 2024-05-12T22:56:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.232+0000 7f4120975640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 0x7f4108069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.236+0000 7f4120975640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 0x7f4108069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f410c0010f0 tx=0x7f410c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.236+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f411c1ddc80 con 0x7f411c1de4e0 2024-05-12T22:56:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.400+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f411c13d2e0 con 0x7f411c1de4e0 2024-05-12T22:56:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.400+0000 7f41197fa640 1 -- 172.21.15.40:0/2890612344 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f4114016f30 con 0x7f411c1de4e0 2024-05-12T22:56:48.404 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:56:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 msgr2=0x7f4108069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 0x7f4108069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f410c0010f0 tx=0x7f410c009040 comp rx=0 tx=0).stop 2024-05-12T22:56:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 msgr2=0x7f411c1e11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4114007040 tx=0x7f4104005840 comp rx=0 tx=0).stop 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 shutdown_connections 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f411c1de4e0 0x7f411c1e11c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f411c14fd80 0x7f411c1ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f41080678f0 0x7f4108069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 --2- 172.21.15.40:0/2890612344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4104004d50 0x7f411c146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 >> 172.21.15.40:0/2890612344 conn(0x7f411c06b6c0 msgr2=0x7f411c0b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 shutdown_connections 2024-05-12T22:56:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.404+0000 7f4122bd9640 1 -- 172.21.15.40:0/2890612344 wait complete. 2024-05-12T22:56:48.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-12T22:56:48.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 Processor -- start 2024-05-12T22:56:48.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 -- start start 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fae640726e0 0x7fae640b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae64144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae640b1e90 con 0x7fae640b5d70 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fae640b6150 con 0x7fae640726e0 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae6b1e4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fae640b52e0 con 0x7fae641442c0 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae640b5d70 0x7fae64071fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59406/0 (socket says 172.21.15.40:59406) 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 -- 172.21.15.40:0/2879009720 learned_addr learned my addr 172.21.15.40:0/2879009720 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae69781640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae64144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae63fff640 1 --2- 172.21.15.40:0/2879009720 >> v2:172.21.15.47:3300/0 conn(0x7fae640726e0 0x7fae640b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818503470 0 0) 0x7fae640b1e90 con 0x7fae640b5d70 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c003530 con 0x7fae640b5d70 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086857771 0 0) 0x7fae4c003530 con 0x7fae640b5d70 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 msgr2=0x7fae64144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae64144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 >> v2:172.21.15.47:3300/0 conn(0x7fae640726e0 msgr2=0x7fae640b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 --2- 172.21.15.40:0/2879009720 >> v2:172.21.15.47:3300/0 conn(0x7fae640726e0 0x7fae640b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae64144c90 con 0x7fae640b5d70 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fae54001680 con 0x7fae640b5d70 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 >> v1:172.21.15.40:6789/0 conn(0x7fae640b5d70 legacy=0x7fae64071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae4c004810 0x7fae4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fae640b6150 con 0x7fae4c0039c0 2024-05-12T22:56:48.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae640b52e0 con 0x7fae4c004810 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fae4c00bab0 con 0x7fae641442c0 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae63fff640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae4c004810 0x7fae4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae69781640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 -- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 msgr2=0x7fae4c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641442c0 0x7fae4c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 -- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae4c004810 msgr2=0x7fae4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae4c004810 0x7fae4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae68f80640 1 -- 172.21.15.40:0/2879009720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c003530 con 0x7fae4c0039c0 2024-05-12T22:56:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.556+0000 7fae63fff640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae4c004810 0x7fae4c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae4c003de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c160 tx=0x7fae5401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42b410216d416f server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54007c90 con 0x7fae4c0039c0 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae540a9020 con 0x7fae4c0039c0 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae637fe640 1 -- 172.21.15.40:0/2879009720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54005b00 con 0x7fae4c0039c0 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- 172.21.15.40:0/2879009720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 msgr2=0x7fae4c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/2879009720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae4c003de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c160 tx=0x7fae5401cba0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae69781640 1 -- 172.21.15.40:0/2879009720 reap_dead start 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- 172.21.15.40:0/2879009720 shutdown_connections 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- 172.21.15.40:0/2879009720 >> 172.21.15.40:0/2879009720 conn(0x7fae6406b6c0 msgr2=0x7fae6406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- 172.21.15.40:0/2879009720 shutdown_connections 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- 172.21.15.40:0/2879009720 wait complete. 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 Processor -- start 2024-05-12T22:56:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- start start 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 0x7fae640aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641e06c0 0x7fae641e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fae640b3fa0 con 0x7fae4c0039c0 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae640b3e20 con 0x7fae640b6ed0 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae6b1e4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fae640b4120 con 0x7fae641e06c0 2024-05-12T22:56:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59216/0 (socket says 172.21.15.40:59216) 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 -- 172.21.15.40:0/3900724596 learned_addr learned my addr 172.21.15.40:0/3900724596 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae63fff640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 0x7fae640aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae69781640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641e06c0 0x7fae641e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 -- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641e06c0 msgr2=0x7fae641e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641e06c0 0x7fae641e0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 -- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 msgr2=0x7fae640aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 0x7fae640aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 -- 172.21.15.40:0/3900724596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae640b8490 con 0x7fae4c0039c0 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae63fff640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 0x7fae640aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.560+0000 7fae68f80640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c160 tx=0x7fae4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540049f0 con 0x7fae4c0039c0 2024-05-12T22:56:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae54004b90 con 0x7fae4c0039c0 2024-05-12T22:56:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae640b7440 con 0x7fae4c0039c0 2024-05-12T22:56:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540070d0 con 0x7fae4c0039c0 2024-05-12T22:56:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae640b7720 con 0x7fae4c0039c0 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae640ae690 con 0x7fae4c0039c0 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae54007270 con 0x7fae4c0039c0 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 0x7fae50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae63fff640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 0x7fae50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fae5411f260 con 0x7fae4c0039c0 2024-05-12T22:56:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.564+0000 7fae63fff640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 0x7fae50069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae640b4e50 tx=0x7fae58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.568+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fae540168b0 con 0x7fae4c0039c0 2024-05-12T22:56:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.732+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae64068330 con 0x7fae4c0039c0 2024-05-12T22:56:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.736+0000 7fae617fa640 1 -- 172.21.15.40:0/3900724596 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fae540b6e40 con 0x7fae4c0039c0 2024-05-12T22:56:48.738 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-05-12T22:56:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.736+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 msgr2=0x7fae50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.736+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 0x7fae50069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae640b4e50 tx=0x7fae58008040 comp rx=0 tx=0).stop 2024-05-12T22:56:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.736+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 msgr2=0x7fae64140b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.736+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c160 tx=0x7fae4c005840 comp rx=0 tx=0).stop 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 shutdown_connections 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae641e06c0 0x7fae641e0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fae500678c0 0x7fae50069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae640b6ed0 0x7fae640aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 --2- 172.21.15.40:0/3900724596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae4c0039c0 0x7fae64140b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 >> 172.21.15.40:0/3900724596 conn(0x7fae6406b6c0 msgr2=0x7fae640b92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 shutdown_connections 2024-05-12T22:56:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.740+0000 7fae6b1e4640 1 -- 172.21.15.40:0/3900724596 wait complete. 2024-05-12T22:56:48.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-12T22:56:48.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 Processor -- start 2024-05-12T22:56:48.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 -- start start 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fecc00b7090 0x7fecc00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fecc0141a10 0x7fecc0072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc00b7470 con 0x7fecc00b5000 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fecc0070870 con 0x7fecc0141a10 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecc4975640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fecc00b5c40 con 0x7fecc00b7090 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fecc0141a10 0x7fecc0072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fecc0141a10 0x7fecc0072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59232/0 (socket says 172.21.15.40:59232) 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 -- 172.21.15.40:0/743945503 learned_addr learned my addr 172.21.15.40:0/743945503 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbe59c640 1 --2- 172.21.15.40:0/743945503 >> v2:172.21.15.47:3300/0 conn(0x7fecc00b7090 0x7fecc00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 -- 172.21.15.40:0/743945503 >> v2:172.21.15.47:3300/0 conn(0x7fecc00b7090 msgr2=0x7fecc00b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 --2- 172.21.15.40:0/743945503 >> v2:172.21.15.47:3300/0 conn(0x7fecc00b7090 0x7fecc00b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 -- 172.21.15.40:0/743945503 >> v1:172.21.15.47:6789/0 conn(0x7fecc00b5000 legacy=0x7fecc0141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:48.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.884+0000 7fecbed9d640 1 -- 172.21.15.40:0/743945503 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc00b4620 con 0x7fecc0141a10 2024-05-12T22:56:48.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbed9d640 1 --2- 172.21.15.40:0/743945503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc0141a10 0x7fecc0072050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fecc00ba860 tx=0x7fecb801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d4bd1c6c480e09 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbd59a640 1 -- 172.21.15.40:0/743945503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80b0070 con 0x7fecc0141a10 2024-05-12T22:56:48.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbd59a640 1 -- 172.21.15.40:0/743945503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb80ab600 con 0x7fecc0141a10 2024-05-12T22:56:48.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbd59a640 1 -- 172.21.15.40:0/743945503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80ab9d0 con 0x7fecc0141a10 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- 172.21.15.40:0/743945503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc0141a10 msgr2=0x7fecc0072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- 172.21.15.40:0/743945503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc0141a10 0x7fecc0072050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fecc00ba860 tx=0x7fecb801c4e0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- 172.21.15.40:0/743945503 shutdown_connections 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- 172.21.15.40:0/743945503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc0141a10 0x7fecc0072050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- 172.21.15.40:0/743945503 >> v2:172.21.15.47:3300/0 conn(0x7fecc00b7090 0x7fecc00b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- 172.21.15.40:0/743945503 >> 172.21.15.40:0/743945503 conn(0x7fecc00ba250 msgr2=0x7fecc00b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- 172.21.15.40:0/743945503 shutdown_connections 2024-05-12T22:56:48.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- 172.21.15.40:0/743945503 wait complete. 2024-05-12T22:56:48.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 Processor -- start 2024-05-12T22:56:48.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- start start 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecc00b5000 0x7fecc0137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fecc0141a10 0x7fecc01e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fecc01549a0 con 0x7fecc00b7090 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecc0154820 con 0x7fecc00b5000 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecc4975640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fecc0154b20 con 0x7fecc0141a10 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbdd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbdd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59238/0 (socket says 172.21.15.40:59238) 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.888+0000 7fecbdd9b640 1 -- 172.21.15.40:0/1957187721 learned_addr learned my addr 172.21.15.40:0/1957187721 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbed9d640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fecc0141a10 0x7fecc01e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbe59c640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecc00b5000 0x7fecc0137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 -- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fecc0141a10 msgr2=0x7fecc01e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fecc0141a10 0x7fecc01e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 -- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecc00b5000 msgr2=0x7fecc0137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecc00b5000 0x7fecc0137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 -- 172.21.15.40:0/1957187721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0138de0 con 0x7fecc00b7090 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbdd9b640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c7f0 tx=0x7fecb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0016020 con 0x7fecc00b7090 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb000aa50 con 0x7fecc00b7090 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc0139330 con 0x7fecc00b7090 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb000ae40 con 0x7fecc00b7090 2024-05-12T22:56:48.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc01e0580 con 0x7fecc00b7090 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc0068a40 con 0x7fecc00b7090 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecb0019020 con 0x7fecc00b7090 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fecb0085cb0 con 0x7fecc00b7090 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbe59c640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:48.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.892+0000 7fecbe59c640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 0x7feca0069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecc0134900 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:48.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:48.896+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fecb0020030 con 0x7fecc00b7090 2024-05-12T22:56:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fecc0072990 con 0x7fecc00b7090 2024-05-12T22:56:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecb6ffd640 1 -- 172.21.15.40:0/1957187721 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fecb0056800 con 0x7fecc00b7090 2024-05-12T22:56:49.062 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-05-12T22:56:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 msgr2=0x7feca0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 0x7feca0069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecc0134900 tx=0x7feca8008040 comp rx=0 tx=0).stop 2024-05-12T22:56:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 msgr2=0x7fecc01e3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c7f0 tx=0x7fecb000ccb0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 shutdown_connections 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fecc0141a10 0x7fecc01e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fecc00b7090 0x7fecc01e3290 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 --2- 172.21.15.40:0/1957187721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecc00b5000 0x7fecc0137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 >> 172.21.15.40:0/1957187721 conn(0x7fecc00ba250 msgr2=0x7fecc01479b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 shutdown_connections 2024-05-12T22:56:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.060+0000 7fecc4975640 1 -- 172.21.15.40:0/1957187721 wait complete. 2024-05-12T22:56:49.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 Processor -- start 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 -- start start 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8806c740 0x7fed880b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed880b1f50 0x7fed880b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8806cb20 con 0x7fed880b1530 2024-05-12T22:56:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fed88073140 con 0x7fed880b1f50 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8d088640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fed880b24a0 con 0x7fed8806c740 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed880b1f50 0x7fed880b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fed880b1530 0x7fed880b3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59412/0 (socket says 172.21.15.40:59412) 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.200+0000 7fed8659c640 1 -- 172.21.15.40:0/1145112772 learned_addr learned my addr 172.21.15.40:0/1145112772 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.204+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14663203 0 0) 0x7fed8806cb20 con 0x7fed880b1530 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.204+0000 7fed86d9d640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8806c740 0x7fed880b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed74003510 con 0x7fed880b1530 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed8759e640 1 -- 172.21.15.40:0/1145112772 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8806c740 msgr2=0x7fed880b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed8759e640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8806c740 0x7fed880b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed8759e640 1 -- 172.21.15.40:0/1145112772 >> v1:172.21.15.40:6789/0 conn(0x7fed880b1530 legacy=0x7fed880b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3592510411 0 0) 0x7fed74003510 con 0x7fed880b1530 2024-05-12T22:56:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed8759e640 1 -- 172.21.15.40:0/1145112772 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed880b2780 con 0x7fed880b1f50 2024-05-12T22:56:49.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.208+0000 7fed8759e640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed880b1f50 0x7fed880b3d20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed8000be30 tx=0x7fed8001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec8933a89553511 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed800ae020 con 0x7fed880b1f50 2024-05-12T22:56:49.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed800a6480 con 0x7fed880b1f50 2024-05-12T22:56:49.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed85d9b640 1 -- 172.21.15.40:0/1145112772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed780016a0 con 0x7fed880b1f50 2024-05-12T22:56:49.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/1145112772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed880b1f50 msgr2=0x7fed880b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed880b1f50 0x7fed880b3d20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed8000be30 tx=0x7fed8001c870 comp rx=0 tx=0).stop 2024-05-12T22:56:49.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/1145112772 shutdown_connections 2024-05-12T22:56:49.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed880b1f50 0x7fed880b3d20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- 172.21.15.40:0/1145112772 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8806c740 0x7fed880b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/1145112772 >> 172.21.15.40:0/1145112772 conn(0x7fed880b8de0 msgr2=0x7fed880b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/1145112772 shutdown_connections 2024-05-12T22:56:49.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/1145112772 wait complete. 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 Processor -- start 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- start start 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed880b1f50 0x7fed881ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8814d120 0x7fed881ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fed880b4260 con 0x7fed8806c740 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed880b4d80 con 0x7fed880b1f50 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fed880b43e0 con 0x7fed8814d120 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59250/0 (socket says 172.21.15.40:59250) 2024-05-12T22:56:49.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 -- 172.21.15.40:0/3752664042 learned_addr learned my addr 172.21.15.40:0/3752664042 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8759e640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8814d120 0x7fed881ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8659c640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed880b1f50 0x7fed881ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 -- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8814d120 msgr2=0x7fed881ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8814d120 0x7fed881ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 -- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed880b1f50 msgr2=0x7fed881ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed880b1f50 0x7fed881ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 -- 172.21.15.40:0/3752664042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88159790 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed86d9d640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e930 tx=0x7fed7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70017070 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7000ca00 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8814d940 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7000cdb0 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.212+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8814dbe0 con 0x7fed8806c740 2024-05-12T22:56:49.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed88068330 con 0x7fed8806c740 2024-05-12T22:56:49.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed7001a070 con 0x7fed8806c740 2024-05-12T22:56:49.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed7f7fe640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 0x7fed68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fed70085cc0 con 0x7fed8806c740 2024-05-12T22:56:49.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed8659c640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 0x7fed68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.216+0000 7fed8659c640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 0x7fed68069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed880754f0 tx=0x7fed78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.220+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fed700568d0 con 0x7fed8806c740 2024-05-12T22:56:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.396+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fed88072230 con 0x7fed8806c740 2024-05-12T22:56:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed7f7fe640 1 -- 172.21.15.40:0/3752664042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fed700561d0 con 0x7fed8806c740 2024-05-12T22:56:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-05-12T22:56:49.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 msgr2=0x7fed68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 0x7fed68069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed880754f0 tx=0x7fed78009040 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 msgr2=0x7fed88158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e930 tx=0x7fed7000edf0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 shutdown_connections 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fed8814d120 0x7fed881ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fed680678c0 0x7fed68069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed880b1f50 0x7fed881ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 --2- 172.21.15.40:0/3752664042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed8806c740 0x7fed88158100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 >> 172.21.15.40:0/3752664042 conn(0x7fed880b8de0 msgr2=0x7fed8815a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 shutdown_connections 2024-05-12T22:56:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.400+0000 7fed8d088640 1 -- 172.21.15.40:0/3752664042 wait complete. 2024-05-12T22:56:49.420 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-05-12T22:56:49.420 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-12T22:56:49.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:56:49.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 Processor -- start 2024-05-12T22:56:49.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 -- start start 2024-05-12T22:56:49.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bac0b5d70 0x7f2bac148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 0x7f2bac148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac0b6150 con 0x7f2bac0b2c50 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2bac06f990 con 0x7f2bac0b5d70 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bb1b7d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2bac0708b0 con 0x7f2bac13f760 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bac0b5d70 0x7f2bac148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bac0b5d70 0x7f2bac148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59252/0 (socket says 172.21.15.40:59252) 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 -- 172.21.15.40:0/2368864666 learned_addr learned my addr 172.21.15.40:0/2368864666 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2babfff640 1 --2- 172.21.15.40:0/2368864666 >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 0x7f2bac148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 -- 172.21.15.40:0/2368864666 >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 msgr2=0x7f2bac148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/2368864666 >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 0x7f2bac148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 -- 172.21.15.40:0/2368864666 >> v1:172.21.15.47:6789/0 conn(0x7f2bac0b2c50 legacy=0x7f2bac13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:49.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2bab7fe640 1 -- 172.21.15.40:0/2368864666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac06f620 con 0x7f2bac0b5d70 2024-05-12T22:56:49.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.596+0000 7f2babfff640 1 --2- 172.21.15.40:0/2368864666 >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 0x7f2bac148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:49.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/2368864666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac148960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bac146390 tx=0x7f2b9c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c9d59a5ca782eb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baa7fc640 1 -- 172.21.15.40:0/2368864666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0a7070 con 0x7f2bac0b5d70 2024-05-12T22:56:49.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baa7fc640 1 -- 172.21.15.40:0/2368864666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0b0070 con 0x7f2bac0b5d70 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baa7fc640 1 -- 172.21.15.40:0/2368864666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ab890 con 0x7f2bac0b5d70 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/2368864666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 msgr2=0x7f2bac148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/2368864666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac148960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bac146390 tx=0x7f2b9c01c450 comp rx=0 tx=0).stop 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/2368864666 shutdown_connections 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/2368864666 >> v2:172.21.15.47:3300/0 conn(0x7f2bac13f760 0x7f2bac148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/2368864666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac148960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/2368864666 >> 172.21.15.40:0/2368864666 conn(0x7f2bac06b6c0 msgr2=0x7f2bac06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/2368864666 shutdown_connections 2024-05-12T22:56:49.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/2368864666 wait complete. 2024-05-12T22:56:49.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 Processor -- start 2024-05-12T22:56:49.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- start start 2024-05-12T22:56:49.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 0x7f2bac137690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2bac13f760 0x7f2bac1e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac1526f0 con 0x7f2bac0b5d70 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac152570 con 0x7f2bac0b2c50 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2bb1b7d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2bac152870 con 0x7f2bac13f760 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59256/0 (socket says 172.21.15.40:59256) 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.600+0000 7f2baaffd640 1 -- 172.21.15.40:0/3507499111 learned_addr learned my addr 172.21.15.40:0/3507499111 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 0x7f2bac137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 -- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2bac13f760 msgr2=0x7f2bac1e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2bac13f760 0x7f2bac1e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 -- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 msgr2=0x7f2bac137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 0x7f2bac137690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 -- 172.21.15.40:0/3507499111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac0b6d90 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 0x7f2bac137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2baaffd640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c440 tx=0x7f2ba000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0016020 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba0012830 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0012c20 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bac0b7070 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bac13d540 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bac068330 con 0x7f2bac0b5d70 2024-05-12T22:56:49.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ba0019020 con 0x7f2bac0b5d70 2024-05-12T22:56:49.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 0x7f2b98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2ba0085c00 con 0x7f2bac0b5d70 2024-05-12T22:56:49.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 0x7f2b98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.604+0000 7f2bab7fe640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 0x7f2b98069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0af000 tx=0x7f2b9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.608+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2ba008c080 con 0x7f2bac0b5d70 2024-05-12T22:56:49.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.764+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bac0679a0 con 0x7f2bac0b5d70 2024-05-12T22:56:49.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.768+0000 7f2b93fff640 1 -- 172.21.15.40:0/3507499111 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16783 (secure 0 0 0) 0x7f2ba0020020 con 0x7f2bac0b5d70 2024-05-12T22:56:49.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:49.773 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:53:16.686879+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:56:49.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 msgr2=0x7f2b98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 0x7f2b98069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0af000 tx=0x7f2b9c008040 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 msgr2=0x7f2bac13dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c440 tx=0x7f2ba000c900 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 shutdown_connections 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2bac13f760 0x7f2bac1e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bac0b5d70 0x7f2bac13dd40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2b980678f0 0x7f2b98069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 --2- 172.21.15.40:0/3507499111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2bac0b2c50 0x7f2bac137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 >> 172.21.15.40:0/3507499111 conn(0x7f2bac06b6c0 msgr2=0x7f2bac0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 shutdown_connections 2024-05-12T22:56:49.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.772+0000 7f2bb1b7d640 1 -- 172.21.15.40:0/3507499111 wait complete. 2024-05-12T22:56:49.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-12T22:52:21.426108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-12T22:52:33.297648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-12T22:52:33.880238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-12T22:56:49.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-12T22:56:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 Processor -- start 2024-05-12T22:56:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 -- start start 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f861c1422a0 0x7f861c142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c148860 0x7f861c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f861c1491f0 con 0x7f861c0b5d70 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f861c142c70 con 0x7f861c148860 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8620e5e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f861c0b6150 con 0x7f861c1422a0 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c148860 0x7f861c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c148860 0x7f861c148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60336/0 (socket says 172.21.15.40:60336) 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 -- 172.21.15.40:0/546439972 learned_addr learned my addr 172.21.15.40:0/546439972 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f8619d9b640 1 --2- 172.21.15.40:0/546439972 >> v2:172.21.15.47:3300/0 conn(0x7f861c1422a0 0x7f861c142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 -- 172.21.15.40:0/546439972 >> v2:172.21.15.47:3300/0 conn(0x7f861c1422a0 msgr2=0x7f861c142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 --2- 172.21.15.40:0/546439972 >> v2:172.21.15.47:3300/0 conn(0x7f861c1422a0 0x7f861c142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 -- 172.21.15.40:0/546439972 >> v1:172.21.15.47:6789/0 conn(0x7f861c0b5d70 legacy=0x7f861c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.908+0000 7f861ad9d640 1 -- 172.21.15.40:0/546439972 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c0b4e70 con 0x7f861c148860 2024-05-12T22:56:49.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f861ad9d640 1 --2- 172.21.15.40:0/546439972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c148860 0x7f861c148cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f861c06dee0 tx=0x7f860c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968c3dfdc8454b64 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f861959a640 1 -- 172.21.15.40:0/546439972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0b0070 con 0x7f861c148860 2024-05-12T22:56:49.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f861959a640 1 -- 172.21.15.40:0/546439972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860c0ab600 con 0x7f861c148860 2024-05-12T22:56:49.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f861959a640 1 -- 172.21.15.40:0/546439972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0ab9d0 con 0x7f861c148860 2024-05-12T22:56:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- 172.21.15.40:0/546439972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c148860 msgr2=0x7f861c148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- 172.21.15.40:0/546439972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c148860 0x7f861c148cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f861c06dee0 tx=0x7f860c01c400 comp rx=0 tx=0).stop 2024-05-12T22:56:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- 172.21.15.40:0/546439972 shutdown_connections 2024-05-12T22:56:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- 172.21.15.40:0/546439972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c148860 0x7f861c148cb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- 172.21.15.40:0/546439972 >> v2:172.21.15.47:3300/0 conn(0x7f861c1422a0 0x7f861c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- 172.21.15.40:0/546439972 >> 172.21.15.40:0/546439972 conn(0x7f861c06b6c0 msgr2=0x7f861c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- 172.21.15.40:0/546439972 shutdown_connections 2024-05-12T22:56:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- 172.21.15.40:0/546439972 wait complete. 2024-05-12T22:56:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 Processor -- start 2024-05-12T22:56:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- start start 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f861c0b5d70 0x7f861c139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f861c148860 0x7f861c135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f861c152710 con 0x7f861c1422a0 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f861c152590 con 0x7f861c148860 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8620e5e640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f861c152890 con 0x7f861c0b5d70 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8619d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8619d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60344/0 (socket says 172.21.15.40:60344) 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.912+0000 7f8619d9b640 1 -- 172.21.15.40:0/746679235 learned_addr learned my addr 172.21.15.40:0/746679235 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f861ad9d640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f861c148860 0x7f861c135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f861a59c640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f861c0b5d70 0x7f861c139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 -- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f861c0b5d70 msgr2=0x7f861c139460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f861c0b5d70 0x7f861c139460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 -- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f861c148860 msgr2=0x7f861c135350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f861c148860 0x7f861c135350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 -- 172.21.15.40:0/746679235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c13a9c0 con 0x7f861c1422a0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8619d9b640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f860400d830 tx=0x7f860400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400b6c0 con 0x7f861c1422a0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8604019070 con 0x7f861c1422a0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c13aca0 con 0x7f861c1422a0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400ba60 con 0x7f861c1422a0 2024-05-12T22:56:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c13b130 con 0x7f861c1422a0 2024-05-12T22:56:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861c068330 con 0x7f861c1422a0 2024-05-12T22:56:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f860401e460 con 0x7f861c1422a0 2024-05-12T22:56:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 0x7f85fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:49.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8604086380 con 0x7f861c1422a0 2024-05-12T22:56:49.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f861a59c640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 0x7f85fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:49.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.916+0000 7f861a59c640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 0x7f85fc069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8614001c20 tx=0x7f8614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:49.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:49.920+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8604056ed0 con 0x7f861c1422a0 2024-05-12T22:56:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.084+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f861c06be40 con 0x7f861c1422a0 2024-05-12T22:56:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8612ffd640 1 -- 172.21.15.40:0/746679235 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f86040567d0 con 0x7f861c1422a0 2024-05-12T22:56:50.090 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 msgr2=0x7f85fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 0x7f85fc069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8614001c20 tx=0x7f8614009040 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 msgr2=0x7f861c134e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f860400d830 tx=0x7f860400dcf0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 shutdown_connections 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f85fc0678c0 0x7f85fc069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f861c148860 0x7f861c135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c1422a0 0x7f861c134e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 --2- 172.21.15.40:0/746679235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f861c0b5d70 0x7f861c139460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 >> 172.21.15.40:0/746679235 conn(0x7f861c06b6c0 msgr2=0x7f861c143150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 shutdown_connections 2024-05-12T22:56:50.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.088+0000 7f8620e5e640 1 -- 172.21.15.40:0/746679235 wait complete. 2024-05-12T22:56:50.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-12T22:56:50.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.220+0000 7f7ed686d640 1 Processor -- start 2024-05-12T22:56:50.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 -- start start 2024-05-12T22:56:50.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ed00b5d70 0x7f7ed00b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 0x7f7ed0142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed00b2f40 con 0x7f7ed0148860 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed0142c70 con 0x7f7ed00b5d70 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed00b6150 con 0x7f7ed01422a0 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ed00b5d70 0x7f7ed00b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed4e0a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ed0148860 0x7f7ed0148c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57406/0 (socket says 172.21.15.40:57406) 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 --2- 172.21.15.40:0/303428111 >> v2:172.21.15.40:3300/0 conn(0x7f7ed00b5d70 0x7f7ed00b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60358/0 (socket says 172.21.15.40:60358) 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed4e0a640 1 -- 172.21.15.40:0/303428111 learned_addr learned my addr 172.21.15.40:0/303428111 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecf7fe640 1 --2- 172.21.15.40:0/303428111 >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 0x7f7ed0142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 -- 172.21.15.40:0/303428111 >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 msgr2=0x7f7ed0142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 --2- 172.21.15.40:0/303428111 >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 0x7f7ed0142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 -- 172.21.15.40:0/303428111 >> v1:172.21.15.40:6789/0 conn(0x7f7ed0148860 legacy=0x7f7ed0148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 -- 172.21.15.40:0/303428111 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed00b4e70 con 0x7f7ed00b5d70 2024-05-12T22:56:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecf7fe640 1 --2- 172.21.15.40:0/303428111 >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 0x7f7ed0142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ecffff640 1 --2- 172.21.15.40:0/303428111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed00b2a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ed006dee0 tx=0x7f7ec401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588622203a628c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7eceffd640 1 -- 172.21.15.40:0/303428111 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b0070 con 0x7f7ed00b5d70 2024-05-12T22:56:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7eceffd640 1 -- 172.21.15.40:0/303428111 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40ab600 con 0x7f7ed00b5d70 2024-05-12T22:56:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7eceffd640 1 -- 172.21.15.40:0/303428111 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40ab9d0 con 0x7f7ed00b5d70 2024-05-12T22:56:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.224+0000 7f7ed686d640 1 -- 172.21.15.40:0/303428111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 msgr2=0x7f7ed00b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- 172.21.15.40:0/303428111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed00b2a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ed006dee0 tx=0x7f7ec401c360 comp rx=0 tx=0).stop 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/303428111 shutdown_connections 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- 172.21.15.40:0/303428111 >> v2:172.21.15.47:3300/0 conn(0x7f7ed01422a0 0x7f7ed0142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- 172.21.15.40:0/303428111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed00b2a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/303428111 >> 172.21.15.40:0/303428111 conn(0x7f7ed006b6c0 msgr2=0x7f7ed006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/303428111 shutdown_connections 2024-05-12T22:56:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/303428111 wait complete. 2024-05-12T22:56:50.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 Processor -- start 2024-05-12T22:56:50.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- start start 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ed01422a0 0x7f7ed00b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0148860 0x7f7ed014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0152710 con 0x7f7ed00b5d70 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0152590 con 0x7f7ed0148860 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed0152890 con 0x7f7ed01422a0 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60370/0 (socket says 172.21.15.40:60370) 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 -- 172.21.15.40:0/3047497239 learned_addr learned my addr 172.21.15.40:0/3047497239 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 -- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ed01422a0 msgr2=0x7f7ed00b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ed01422a0 0x7f7ed00b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 -- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0148860 msgr2=0x7f7ed014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0148860 0x7f7ed014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 -- 172.21.15.40:0/3047497239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed0147930 con 0x7f7ed00b5d70 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ecffff640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4018f70 tx=0x7f7ec4019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b0040 con 0x7f7ed00b5d70 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40b9070 con 0x7f7ed00b5d70 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed014f780 con 0x7f7ed00b5d70 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b4830 con 0x7f7ed00b5d70 2024-05-12T22:56:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed00b0eb0 con 0x7f7ed00b5d70 2024-05-12T22:56:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.228+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed0068330 con 0x7f7ed00b5d70 2024-05-12T22:56:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.232+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ec40ab4c0 con 0x7f7ed00b5d70 2024-05-12T22:56:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.232+0000 7f7eccff9640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 0x7f7ebc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.232+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7ec411faf0 con 0x7f7ed00b5d70 2024-05-12T22:56:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.232+0000 7f7ecf7fe640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 0x7f7ebc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.232+0000 7f7ecf7fe640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 0x7f7ebc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0138de0 tx=0x7f7ec0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.236+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7ec4016070 con 0x7f7ed00b5d70 2024-05-12T22:56:50.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.396+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ed01463a0 con 0x7f7ed00b5d70 2024-05-12T22:56:50.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.396+0000 7f7eccff9640 1 -- 172.21.15.40:0/3047497239 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f7ec40f0640 con 0x7f7ed00b5d70 2024-05-12T22:56:50.400 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 msgr2=0x7f7ebc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 0x7f7ebc069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0138de0 tx=0x7f7ec0008040 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 msgr2=0x7f7ed0146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4018f70 tx=0x7f7ec4019100 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 shutdown_connections 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ebc0678c0 0x7f7ebc069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0148860 0x7f7ed014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ed01422a0 0x7f7ed00b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 --2- 172.21.15.40:0/3047497239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ed00b5d70 0x7f7ed0146780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 >> 172.21.15.40:0/3047497239 conn(0x7f7ed006b6c0 msgr2=0x7f7ed0145250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 shutdown_connections 2024-05-12T22:56:50.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.400+0000 7f7ed686d640 1 -- 172.21.15.40:0/3047497239 wait complete. 2024-05-12T22:56:50.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-12T22:56:50.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 Processor -- start 2024-05-12T22:56:50.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 -- start start 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe6641534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe664147b10 con 0x7fe664141380 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6640b4660 con 0x7fe664147730 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe66aaca640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640b6d10 con 0x7fe664141800 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe663fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe664141380 0x7fe66414fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57412/0 (socket says 172.21.15.40:57412) 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe663fff640 1 -- 172.21.15.40:0/918566984 learned_addr learned my addr 172.21.15.40:0/918566984 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe669067640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe6641534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940823430 0 0) 0x7fe664147b10 con 0x7fe664141380 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe650003530 con 0x7fe664141380 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 156470315 0 0) 0x7fe650003530 con 0x7fe664141380 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 msgr2=0x7fe6641534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe6641534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 >> v1:172.21.15.47:6789/0 conn(0x7fe664147730 legacy=0x7fe664147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640b6f40 con 0x7fe664141380 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fe654001a00 con 0x7fe664141380 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 >> v1:172.21.15.40:6789/0 conn(0x7fe664141380 legacy=0x7fe66414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6500039f0 0x7fe650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe650004d50 0x7fe6500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe65000bb60 con 0x7fe6500039f0 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe65000bce0 con 0x7fe650004d50 2024-05-12T22:56:50.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe65000beb0 con 0x7fe664141800 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6500039f0 0x7fe650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe669067640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe650004d50 0x7fe6500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe663fff640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 -- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 msgr2=0x7fe650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe650004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 -- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe650004d50 msgr2=0x7fe6500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe650004d50 0x7fe6500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe668866640 1 -- 172.21.15.40:0/918566984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe650003530 con 0x7fe6500039f0 2024-05-12T22:56:50.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.536+0000 7fe663fff640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664141800 0x7fe650004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:50.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe668866640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6500039f0 0x7fe650003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe64c001890 tx=0x7fe64c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181d6e3087e505e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0b0070 con 0x7fe6500039f0 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c0ab600 con 0x7fe6500039f0 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe6637fe640 1 -- 172.21.15.40:0/918566984 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c001460 con 0x7fe6500039f0 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- 172.21.15.40:0/918566984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6500039f0 msgr2=0x7fe650003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 --2- 172.21.15.40:0/918566984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6500039f0 0x7fe650003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe64c001890 tx=0x7fe64c01c500 comp rx=0 tx=0).stop 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe669067640 1 -- 172.21.15.40:0/918566984 reap_dead start 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- 172.21.15.40:0/918566984 shutdown_connections 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- 172.21.15.40:0/918566984 >> 172.21.15.40:0/918566984 conn(0x7fe6640bce70 msgr2=0x7fe6640bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- 172.21.15.40:0/918566984 shutdown_connections 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- 172.21.15.40:0/918566984 wait complete. 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 Processor -- start 2024-05-12T22:56:50.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.540+0000 7fe66aaca640 1 -- start start 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664139710 0x7fe664149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6641e2d20 0x7fe6641e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe6640b9520 con 0x7fe6640bb350 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe664141c10 con 0x7fe6641e2d20 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640b77f0 con 0x7fe664139710 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60386/0 (socket says 172.21.15.40:60386) 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 -- 172.21.15.40:0/3259309299 learned_addr learned my addr 172.21.15.40:0/3259309299 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe663fff640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664139710 0x7fe664149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 -- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664139710 msgr2=0x7fe664149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664139710 0x7fe664149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 -- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6641e2d20 msgr2=0x7fe6641e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe669067640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6641e2d20 0x7fe6641e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6641e2d20 0x7fe6641e31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 -- 172.21.15.40:0/3259309299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe664138220 con 0x7fe6640bb350 2024-05-12T22:56:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe668866640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01cda0 tx=0x7fe650005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0bb070 con 0x7fe6640bb350 2024-05-12T22:56:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c001440 con 0x7fe6640bb350 2024-05-12T22:56:50.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0b0040 con 0x7fe6640bb350 2024-05-12T22:56:50.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6640bb730 con 0x7fe6640bb350 2024-05-12T22:56:50.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.544+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66414b4b0 con 0x7fe6640bb350 2024-05-12T22:56:50.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664068330 con 0x7fe6640bb350 2024-05-12T22:56:50.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe64c0069e0 con 0x7fe6640bb350 2024-05-12T22:56:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe6617fa640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 0x7fe644069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe663fff640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 0x7fe644069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe64c11f390 con 0x7fe6640bb350 2024-05-12T22:56:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.548+0000 7fe663fff640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 0x7fe644069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe654002240 tx=0x7fe654009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.552+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe64c016210 con 0x7fe6640bb350 2024-05-12T22:56:50.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.708+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6641400e0 con 0x7fe6640bb350 2024-05-12T22:56:50.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.708+0000 7fe6617fa640 1 -- 172.21.15.40:0/3259309299 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe64c0ef810 con 0x7fe6640bb350 2024-05-12T22:56:50.712 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-05-12T22:56:50.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 msgr2=0x7fe644069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 0x7fe644069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe654002240 tx=0x7fe654009040 comp rx=0 tx=0).stop 2024-05-12T22:56:50.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 msgr2=0x7fe664137ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01cda0 tx=0x7fe650005840 comp rx=0 tx=0).stop 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 shutdown_connections 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fe6440678c0 0x7fe644069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6641e2d20 0x7fe6641e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe664139710 0x7fe664149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 --2- 172.21.15.40:0/3259309299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6640bb350 0x7fe664137ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 >> 172.21.15.40:0/3259309299 conn(0x7fe6640bce70 msgr2=0x7fe6640bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 shutdown_connections 2024-05-12T22:56:50.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.712+0000 7fe66aaca640 1 -- 172.21.15.40:0/3259309299 wait complete. 2024-05-12T22:56:50.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-12T22:56:50.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 Processor -- start 2024-05-12T22:56:50.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 -- start start 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff69c0b5ee0 0x7ff69c144100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff69c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c144640 con 0x7ff69c1477b0 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff69c072930 con 0x7ff69c0b5ee0 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff6a1ab4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c0b62c0 con 0x7ff69c071f40 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff69c1477b0 0x7ff69c147c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57422/0 (socket says 172.21.15.40:57422) 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69affd640 1 -- 172.21.15.40:0/372800904 learned_addr learned my addr 172.21.15.40:0/372800904 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/372800904 >> v2:172.21.15.47:3300/0 conn(0x7ff69c0b5ee0 0x7ff69c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69bfff640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff69c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764989050 0 0) 0x7ff69c144640 con 0x7ff69c1477b0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff684003530 con 0x7ff69c1477b0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3085212697 0 0) 0x7ff684003530 con 0x7ff69c1477b0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 msgr2=0x7ff69c0723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff69c0723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 >> v2:172.21.15.47:3300/0 conn(0x7ff69c0b5ee0 msgr2=0x7ff69c144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 --2- 172.21.15.40:0/372800904 >> v2:172.21.15.47:3300/0 conn(0x7ff69c0b5ee0 0x7ff69c144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c072cf0 con 0x7ff69c1477b0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.848+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7ff690001680 con 0x7ff69c1477b0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 >> v1:172.21.15.40:6789/0 conn(0x7ff69c1477b0 legacy=0x7ff69c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6840039c0 0x7ff684003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff684004810 0x7ff684004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff6840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c072930 con 0x7ff6840039c0 2024-05-12T22:56:50.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c0b62c0 con 0x7ff684004810 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff68400b9d0 con 0x7ff69c071f40 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6840039c0 0x7ff684003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69bfff640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff6840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69affd640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff684004810 0x7ff684004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 -- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 msgr2=0x7ff6840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c071f40 0x7ff6840051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 -- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff684004810 msgr2=0x7ff684004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff684004810 0x7ff684004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 -- 172.21.15.40:0/372800904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684003530 con 0x7ff6840039c0 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6840039c0 0x7ff684003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e170 tx=0x7ff68c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2ebd993a92271 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0b2070 con 0x7ff6840039c0 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c0a59b0 con 0x7ff6840039c0 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69a7fc640 1 -- 172.21.15.40:0/372800904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c009c10 con 0x7ff6840039c0 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/372800904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6840039c0 msgr2=0x7ff684003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/372800904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6840039c0 0x7ff684003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e170 tx=0x7ff68c01cca0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff69bfff640 1 -- 172.21.15.40:0/372800904 reap_dead start 2024-05-12T22:56:50.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/372800904 shutdown_connections 2024-05-12T22:56:50.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/372800904 >> 172.21.15.40:0/372800904 conn(0x7ff69c06b6c0 msgr2=0x7ff69c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:50.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/372800904 shutdown_connections 2024-05-12T22:56:50.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.852+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/372800904 wait complete. 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 Processor -- start 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- start start 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6840039c0 0x7ff69c0b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c1e0990 0x7ff69c136d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c14f250 con 0x7ff69c1471d0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c072760 con 0x7ff6840039c0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c14f3d0 con 0x7ff69c1e0990 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60408/0 (socket says 172.21.15.40:60408) 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 -- 172.21.15.40:0/866494711 learned_addr learned my addr 172.21.15.40:0/866494711 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6840039c0 0x7ff69c0b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69bfff640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c1e0990 0x7ff69c136d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 -- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c1e0990 msgr2=0x7ff69c136d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c1e0990 0x7ff69c136d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 -- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6840039c0 msgr2=0x7ff69c0b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6840039c0 0x7ff69c0b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 -- 172.21.15.40:0/866494711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1461c0 con 0x7ff69c1471d0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff69affd640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d7e0 tx=0x7ff69000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690019070 con 0x7ff69c1471d0 2024-05-12T22:56:50.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6900074e0 con 0x7ff69c1471d0 2024-05-12T22:56:50.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690004a30 con 0x7ff69c1471d0 2024-05-12T22:56:50.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1dff30 con 0x7ff69c1471d0 2024-05-12T22:56:50.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c145280 con 0x7ff69c1471d0 2024-05-12T22:56:50.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c068330 con 0x7ff69c1471d0 2024-05-12T22:56:50.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.856+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff69001c070 con 0x7ff69c1471d0 2024-05-12T22:56:50.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.860+0000 7ff683fff640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 0x7ff688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:50.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.860+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff6900857b0 con 0x7ff69c1471d0 2024-05-12T22:56:50.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.860+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 0x7ff688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:50.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.860+0000 7ff69b7fe640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 0x7ff688069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:50.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:50.864+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff690056270 con 0x7ff69c1471d0 2024-05-12T22:56:51.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.036+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff69c1e0100 con 0x7ff69c1471d0 2024-05-12T22:56:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff683fff640 1 -- 172.21.15.40:0/866494711 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7ff690055b70 con 0x7ff69c1471d0 2024-05-12T22:56:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-05-12T22:56:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 msgr2=0x7ff688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 0x7ff688069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7040 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 msgr2=0x7ff69c1e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d7e0 tx=0x7ff69000dca0 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 shutdown_connections 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff69c1e0990 0x7ff69c136d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff69c1471d0 0x7ff69c1e0450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff6880678c0 0x7ff688069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 --2- 172.21.15.40:0/866494711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6840039c0 0x7ff69c0b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 >> 172.21.15.40:0/866494711 conn(0x7ff69c06b6c0 msgr2=0x7ff69c06ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 shutdown_connections 2024-05-12T22:56:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:51.040+0000 7ff6a1ab4640 1 -- 172.21.15.40:0/866494711 wait complete. 2024-05-12T22:56:51.062 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-05-12T22:56:51.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:56:51.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-12T22:56:51.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[33224]: fuse finished with error 0 and tester_r 0 2024-05-12T22:56:51.085 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:56:57.189 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:56:57.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:56:57.190 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-12T22:56:57.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:56:57.211 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-05-12T22:56:57.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-12T22:56:57.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:56:57.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-12T22:56:57.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-12T22:56:57.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-05-12T22:56:57.483 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-12T22:56:57.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-12T22:56:57.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:56:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 Processor -- start 2024-05-12T22:56:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 -- start start 2024-05-12T22:56:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efeb00b5a10 0x7efeb00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00b6680 con 0x7efeb014b6f0 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00b5df0 con 0x7efeb0141a90 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb6bc7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7efeb014ac10 con 0x7efeb00b5a10 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeaffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efeb014b6f0 0x7efeb0141380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57436/0 (socket says 172.21.15.40:57436) 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeaffff640 1 -- 172.21.15.40:0/3515381914 learned_addr learned my addr 172.21.15.40:0/3515381914 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb4963640 1 --2- 172.21.15.40:0/3515381914 >> v2:172.21.15.40:3300/0 conn(0x7efeb00b5a10 0x7efeb00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeaf7fe640 1 -- 172.21.15.40:0/3515381914 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252067661 0 0) 0x7efeb00b6680 con 0x7efeb014b6f0 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeaf7fe640 1 -- 172.21.15.40:0/3515381914 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe98003530 con 0x7efeb014b6f0 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb4963640 1 -- 172.21.15.40:0/3515381914 >> v1:172.21.15.47:6789/0 conn(0x7efeb0141a90 legacy=0x7efeb00b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb4963640 1 -- 172.21.15.40:0/3515381914 >> v1:172.21.15.40:6789/0 conn(0x7efeb014b6f0 legacy=0x7efeb0141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.624+0000 7efeb4963640 1 -- 172.21.15.40:0/3515381914 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb014aef0 con 0x7efeb00b5a10 2024-05-12T22:56:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb4963640 1 --2- 172.21.15.40:0/3515381914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb00b5a10 0x7efeb00b6140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efea40097c0 tx=0x7efea401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fb29a936ee3c45 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeaf7fe640 1 -- 172.21.15.40:0/3515381914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea40b0070 con 0x7efeb00b5a10 2024-05-12T22:56:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeaf7fe640 1 -- 172.21.15.40:0/3515381914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea40ab600 con 0x7efeb00b5a10 2024-05-12T22:56:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeaf7fe640 1 -- 172.21.15.40:0/3515381914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea40ab9d0 con 0x7efeb00b5a10 2024-05-12T22:56:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3515381914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb00b5a10 msgr2=0x7efeb00b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3515381914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb00b5a10 0x7efeb00b6140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efea40097c0 tx=0x7efea401c380 comp rx=0 tx=0).stop 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3515381914 shutdown_connections 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3515381914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb00b5a10 0x7efeb00b6140 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3515381914 >> 172.21.15.40:0/3515381914 conn(0x7efeb006e5e0 msgr2=0x7efeb006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3515381914 shutdown_connections 2024-05-12T22:56:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.628+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3515381914 wait complete. 2024-05-12T22:56:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 Processor -- start 2024-05-12T22:56:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- start start 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb00b5a10 0x7efeb0137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efeb0141a90 0x7efeb01478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0155cf0 con 0x7efeb014b6f0 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0155b70 con 0x7efeb00b5a10 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7efeb0155e70 con 0x7efeb0141a90 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60432/0 (socket says 172.21.15.40:60432) 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 -- 172.21.15.40:0/3076233301 learned_addr learned my addr 172.21.15.40:0/3076233301 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb4963640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb00b5a10 0x7efeb0137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeaffff640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efeb0141a90 0x7efeb01478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 -- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efeb0141a90 msgr2=0x7efeb01478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efeb0141a90 0x7efeb01478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 -- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb00b5a10 msgr2=0x7efeb0137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb00b5a10 0x7efeb0137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 -- 172.21.15.40:0/3076233301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01dff50 con 0x7efeb014b6f0 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb5164640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efea800c7a0 tx=0x7efea800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8003b80 con 0x7efeb014b6f0 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8003d20 con 0x7efeb014b6f0 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb0138530 con 0x7efeb014b6f0 2024-05-12T22:56:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800aa30 con 0x7efeb014b6f0 2024-05-12T22:56:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01e01d0 con 0x7efeb014b6f0 2024-05-12T22:56:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0068a40 con 0x7efeb014b6f0 2024-05-12T22:56:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efea800abd0 con 0x7efeb014b6f0 2024-05-12T22:56:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 0x7efe9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7efea8085bc0 con 0x7efeb014b6f0 2024-05-12T22:56:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.632+0000 7efeb4963640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 0x7efe9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.636+0000 7efeb4963640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 0x7efe9c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efea40ad000 tx=0x7efea40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.640+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7efeb01dff50 con 0x7efeb014b6f0 2024-05-12T22:56:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.796+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efeb0136750 con 0x7efe9c0678c0 2024-05-12T22:56:57.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.816+0000 7efead7fa640 1 -- 172.21.15.40:0/3076233301 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252208 (secure 0 0 0) 0x7efeb0136750 con 0x7efe9c0678c0 2024-05-12T22:56:57.822 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:57.824 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 msgr2=0x7efe9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 0x7efe9c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efea40ad000 tx=0x7efea40a6000 comp rx=0 tx=0).stop 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 msgr2=0x7efeb01e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efea800c7a0 tx=0x7efea800cc60 comp rx=0 tx=0).stop 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 shutdown_connections 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efeb014b6f0 0x7efeb01e09d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efeb0141a90 0x7efeb01478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7efe9c0678c0 0x7efe9c069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 --2- 172.21.15.40:0/3076233301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb00b5a10 0x7efeb0137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 >> 172.21.15.40:0/3076233301 conn(0x7efeb006e5e0 msgr2=0x7efeb0135c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 shutdown_connections 2024-05-12T22:56:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:57.820+0000 7efeb6bc7640 1 -- 172.21.15.40:0/3076233301 wait complete. 2024-05-12T22:56:57.842 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-05-12T22:56:57.426980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389671,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":344,"num_write_kb":3287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":871,"ondisk_log_size":871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239408,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754735312,"statfs":{"total":773094113280,"available":772848959488,"internally_reserved":0,"allocated":2539520,"data_stored":3457606,"data_compressed":296616,"data_compressed_allocated":368640,"data_compressed_original":2547712,"omap_allocated":12747,"internal_metadata":242535989},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31297,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":29,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003805"},"pg_stats":[{"pgid":"3.3f","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.177666+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:56:51.177666+0000","last_peered":"2024-05-12T22:56:51.177666+0000","last_clean":"2024-05-12T22:56:51.177666+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:56:51.177666+0000","last_undegraded":"2024-05-12T22:56:51.177666+0000","last_fullsized":"2024-05-12T22:56:51.177666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137815+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:56:51.137815+0000","last_peered":"2024-05-12T22:56:51.137815+0000","last_clean":"2024-05-12T22:56:51.137815+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:56:51.137815+0000","last_undegraded":"2024-05-12T22:56:51.137815+0000","last_fullsized":"2024-05-12T22:56:51.137815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133288+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:56:51.133288+0000","last_peered":"2024-05-12T22:56:51.133288+0000","last_clean":"2024-05-12T22:56:51.133288+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:56:51.133288+0000","last_undegraded":"2024-05-12T22:56:51.133288+0000","last_fullsized":"2024-05-12T22:56:51.133288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183765+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:56:51.183765+0000","last_peered":"2024-05-12T22:56:51.183765+0000","last_clean":"2024-05-12T22:56:51.183765+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:56:51.183765+0000","last_undegraded":"2024-05-12T22:56:51.183765+0000","last_fullsized":"2024-05-12T22:56:51.183765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186544+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:56:51.186544+0000","last_peered":"2024-05-12T22:56:51.186544+0000","last_clean":"2024-05-12T22:56:51.186544+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:56:51.186544+0000","last_undegraded":"2024-05-12T22:56:51.186544+0000","last_fullsized":"2024-05-12T22:56:51.186544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182874+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:56:51.182874+0000","last_peered":"2024-05-12T22:56:51.182874+0000","last_clean":"2024-05-12T22:56:51.182874+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:56:51.182874+0000","last_undegraded":"2024-05-12T22:56:51.182874+0000","last_fullsized":"2024-05-12T22:56:51.182874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.166324+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:56:51.166324+0000","last_peered":"2024-05-12T22:56:51.166324+0000","last_clean":"2024-05-12T22:56:51.166324+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:56:51.166324+0000","last_undegraded":"2024-05-12T22:56:51.166324+0000","last_fullsized":"2024-05-12T22:56:51.166324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178881+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:56:51.178881+0000","last_peered":"2024-05-12T22:56:51.178881+0000","last_clean":"2024-05-12T22:56:51.178881+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:56:51.178881+0000","last_undegraded":"2024-05-12T22:56:51.178881+0000","last_fullsized":"2024-05-12T22:56:51.178881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.180668+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:56:51.180668+0000","last_peered":"2024-05-12T22:56:51.180668+0000","last_clean":"2024-05-12T22:56:51.180668+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:56:51.180668+0000","last_undegraded":"2024-05-12T22:56:51.180668+0000","last_fullsized":"2024-05-12T22:56:51.180668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'16","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188935+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:56:51.188935+0000","last_peered":"2024-05-12T22:56:51.188935+0000","last_clean":"2024-05-12T22:56:51.188935+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:56:51.188935+0000","last_undegraded":"2024-05-12T22:56:51.188935+0000","last_fullsized":"2024-05-12T22:56:51.188935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182310+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:56:51.182310+0000","last_peered":"2024-05-12T22:56:51.182310+0000","last_clean":"2024-05-12T22:56:51.182310+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:56:51.182310+0000","last_undegraded":"2024-05-12T22:56:51.182310+0000","last_fullsized":"2024-05-12T22:56:51.182310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179011+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:56:51.179011+0000","last_peered":"2024-05-12T22:56:51.179011+0000","last_clean":"2024-05-12T22:56:51.179011+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:56:51.179011+0000","last_undegraded":"2024-05-12T22:56:51.179011+0000","last_fullsized":"2024-05-12T22:56:51.179011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173134+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:56:51.173134+0000","last_peered":"2024-05-12T22:56:51.173134+0000","last_clean":"2024-05-12T22:56:51.173134+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:56:51.173134+0000","last_undegraded":"2024-05-12T22:56:51.173134+0000","last_fullsized":"2024-05-12T22:56:51.173134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.120262+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:56:51.120262+0000","last_peered":"2024-05-12T22:56:51.120262+0000","last_clean":"2024-05-12T22:56:51.120262+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:56:51.120262+0000","last_undegraded":"2024-05-12T22:56:51.120262+0000","last_fullsized":"2024-05-12T22:56:51.120262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.171392+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:56:51.171392+0000","last_peered":"2024-05-12T22:56:51.171392+0000","last_clean":"2024-05-12T22:56:51.171392+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:56:51.171392+0000","last_undegraded":"2024-05-12T22:56:51.171392+0000","last_fullsized":"2024-05-12T22:56:51.171392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'11","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.128437+0000","last_change":"2024-05-12T22:53:16.797441+0000","last_active":"2024-05-12T22:56:51.128437+0000","last_peered":"2024-05-12T22:56:51.128437+0000","last_clean":"2024-05-12T22:56:51.128437+0000","last_became_active":"2024-05-12T22:53:16.796573+0000","last_became_peered":"2024-05-12T22:53:16.796573+0000","last_unstale":"2024-05-12T22:56:51.128437+0000","last_undegraded":"2024-05-12T22:56:51.128437+0000","last_fullsized":"2024-05-12T22:56:51.128437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:00:31.347895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179157+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:56:51.179157+0000","last_peered":"2024-05-12T22:56:51.179157+0000","last_clean":"2024-05-12T22:56:51.179157+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:56:51.179157+0000","last_undegraded":"2024-05-12T22:56:51.179157+0000","last_fullsized":"2024-05-12T22:56:51.179157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172422+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:56:51.172422+0000","last_peered":"2024-05-12T22:56:51.172422+0000","last_clean":"2024-05-12T22:56:51.172422+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:56:51.172422+0000","last_undegraded":"2024-05-12T22:56:51.172422+0000","last_fullsized":"2024-05-12T22:56:51.172422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.168264+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:56:51.168264+0000","last_peered":"2024-05-12T22:56:51.168264+0000","last_clean":"2024-05-12T22:56:51.168264+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:56:51.168264+0000","last_undegraded":"2024-05-12T22:56:51.168264+0000","last_fullsized":"2024-05-12T22:56:51.168264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184335+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:56:51.184335+0000","last_peered":"2024-05-12T22:56:51.184335+0000","last_clean":"2024-05-12T22:56:51.184335+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:56:51.184335+0000","last_undegraded":"2024-05-12T22:56:51.184335+0000","last_fullsized":"2024-05-12T22:56:51.184335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.189517+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:56:51.189517+0000","last_peered":"2024-05-12T22:56:51.189517+0000","last_clean":"2024-05-12T22:56:51.189517+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:56:51.189517+0000","last_undegraded":"2024-05-12T22:56:51.189517+0000","last_fullsized":"2024-05-12T22:56:51.189517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186658+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:56:51.186658+0000","last_peered":"2024-05-12T22:56:51.186658+0000","last_clean":"2024-05-12T22:56:51.186658+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:56:51.186658+0000","last_undegraded":"2024-05-12T22:56:51.186658+0000","last_fullsized":"2024-05-12T22:56:51.186658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146422+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:56:51.146422+0000","last_peered":"2024-05-12T22:56:51.146422+0000","last_clean":"2024-05-12T22:56:51.146422+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:56:51.146422+0000","last_undegraded":"2024-05-12T22:56:51.146422+0000","last_fullsized":"2024-05-12T22:56:51.146422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181469+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:56:51.181469+0000","last_peered":"2024-05-12T22:56:51.181469+0000","last_clean":"2024-05-12T22:56:51.181469+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:56:51.181469+0000","last_undegraded":"2024-05-12T22:56:51.181469+0000","last_fullsized":"2024-05-12T22:56:51.181469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.151233+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:56:51.151233+0000","last_peered":"2024-05-12T22:56:51.151233+0000","last_clean":"2024-05-12T22:56:51.151233+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:56:51.151233+0000","last_undegraded":"2024-05-12T22:56:51.151233+0000","last_fullsized":"2024-05-12T22:56:51.151233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188917+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:56:51.188917+0000","last_peered":"2024-05-12T22:56:51.188917+0000","last_clean":"2024-05-12T22:56:51.188917+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:56:51.188917+0000","last_undegraded":"2024-05-12T22:56:51.188917+0000","last_fullsized":"2024-05-12T22:56:51.188917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133086+0000","last_change":"2024-05-12T22:53:16.705033+0000","last_active":"2024-05-12T22:56:51.133086+0000","last_peered":"2024-05-12T22:56:51.133086+0000","last_clean":"2024-05-12T22:56:51.133086+0000","last_became_active":"2024-05-12T22:53:16.704085+0000","last_became_peered":"2024-05-12T22:53:16.704085+0000","last_unstale":"2024-05-12T22:56:51.133086+0000","last_undegraded":"2024-05-12T22:56:51.133086+0000","last_fullsized":"2024-05-12T22:56:51.133086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:11:57.355073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.175677+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:56:51.175677+0000","last_peered":"2024-05-12T22:56:51.175677+0000","last_clean":"2024-05-12T22:56:51.175677+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:56:51.175677+0000","last_undegraded":"2024-05-12T22:56:51.175677+0000","last_fullsized":"2024-05-12T22:56:51.175677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.131434+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:56:51.131434+0000","last_peered":"2024-05-12T22:56:51.131434+0000","last_clean":"2024-05-12T22:56:51.131434+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:56:51.131434+0000","last_undegraded":"2024-05-12T22:56:51.131434+0000","last_fullsized":"2024-05-12T22:56:51.131434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183211+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:56:51.183211+0000","last_peered":"2024-05-12T22:56:51.183211+0000","last_clean":"2024-05-12T22:56:51.183211+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:56:51.183211+0000","last_undegraded":"2024-05-12T22:56:51.183211+0000","last_fullsized":"2024-05-12T22:56:51.183211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.130751+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:56:51.130751+0000","last_peered":"2024-05-12T22:56:51.130751+0000","last_clean":"2024-05-12T22:56:51.130751+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:56:51.130751+0000","last_undegraded":"2024-05-12T22:56:51.130751+0000","last_fullsized":"2024-05-12T22:56:51.130751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.162196+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:56:51.162196+0000","last_peered":"2024-05-12T22:56:51.162196+0000","last_clean":"2024-05-12T22:56:51.162196+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:56:51.162196+0000","last_undegraded":"2024-05-12T22:56:51.162196+0000","last_fullsized":"2024-05-12T22:56:51.162196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146258+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:56:51.146258+0000","last_peered":"2024-05-12T22:56:51.146258+0000","last_clean":"2024-05-12T22:56:51.146258+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:56:51.146258+0000","last_undegraded":"2024-05-12T22:56:51.146258+0000","last_fullsized":"2024-05-12T22:56:51.146258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.628217+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:54:20.628217+0000","last_peered":"2024-05-12T22:54:20.628217+0000","last_clean":"2024-05-12T22:54:20.628217+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:54:20.628217+0000","last_undegraded":"2024-05-12T22:54:20.628217+0000","last_fullsized":"2024-05-12T22:54:20.628217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.142227+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:56:51.142227+0000","last_peered":"2024-05-12T22:56:51.142227+0000","last_clean":"2024-05-12T22:56:51.142227+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:56:51.142227+0000","last_undegraded":"2024-05-12T22:56:51.142227+0000","last_fullsized":"2024-05-12T22:56:51.142227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.632005+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:54:20.632005+0000","last_peered":"2024-05-12T22:54:20.632005+0000","last_clean":"2024-05-12T22:54:20.632005+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:54:20.632005+0000","last_undegraded":"2024-05-12T22:54:20.632005+0000","last_fullsized":"2024-05-12T22:54:20.632005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.636641+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:54:23.636641+0000","last_peered":"2024-05-12T22:54:23.636641+0000","last_clean":"2024-05-12T22:54:23.636641+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:54:23.636641+0000","last_undegraded":"2024-05-12T22:54:23.636641+0000","last_fullsized":"2024-05-12T22:54:23.636641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134633+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:56:51.134633+0000","last_peered":"2024-05-12T22:56:51.134633+0000","last_clean":"2024-05-12T22:56:51.134633+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:56:51.134633+0000","last_undegraded":"2024-05-12T22:56:51.134633+0000","last_fullsized":"2024-05-12T22:56:51.134633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.633590+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:54:23.633590+0000","last_peered":"2024-05-12T22:54:23.633590+0000","last_clean":"2024-05-12T22:54:23.633590+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:54:23.633590+0000","last_undegraded":"2024-05-12T22:54:23.633590+0000","last_fullsized":"2024-05-12T22:54:23.633590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137927+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:56:51.137927+0000","last_peered":"2024-05-12T22:56:51.137927+0000","last_clean":"2024-05-12T22:56:51.137927+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:56:51.137927+0000","last_undegraded":"2024-05-12T22:56:51.137927+0000","last_fullsized":"2024-05-12T22:56:51.137927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.631837+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:54:23.631837+0000","last_peered":"2024-05-12T22:54:23.631837+0000","last_clean":"2024-05-12T22:54:23.631837+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:54:23.631837+0000","last_undegraded":"2024-05-12T22:54:23.631837+0000","last_fullsized":"2024-05-12T22:54:23.631837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169465+0000","last_change":"2024-05-12T22:53:16.797487+0000","last_active":"2024-05-12T22:56:51.169465+0000","last_peered":"2024-05-12T22:56:51.169465+0000","last_clean":"2024-05-12T22:56:51.169465+0000","last_became_active":"2024-05-12T22:53:16.796547+0000","last_became_peered":"2024-05-12T22:53:16.796547+0000","last_unstale":"2024-05-12T22:56:51.169465+0000","last_undegraded":"2024-05-12T22:56:51.169465+0000","last_fullsized":"2024-05-12T22:56:51.169465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:06:32.862154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.634995+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:54:23.634995+0000","last_peered":"2024-05-12T22:54:23.634995+0000","last_clean":"2024-05-12T22:54:23.634995+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:54:23.634995+0000","last_undegraded":"2024-05-12T22:54:23.634995+0000","last_fullsized":"2024-05-12T22:54:23.634995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147092+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:56:51.147092+0000","last_peered":"2024-05-12T22:56:51.147092+0000","last_clean":"2024-05-12T22:56:51.147092+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:56:51.147092+0000","last_undegraded":"2024-05-12T22:56:51.147092+0000","last_fullsized":"2024-05-12T22:56:51.147092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'15","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:48.746525+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:56:48.746525+0000","last_peered":"2024-05-12T22:56:48.746525+0000","last_clean":"2024-05-12T22:56:48.746525+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:56:48.746525+0000","last_undegraded":"2024-05-12T22:56:48.746525+0000","last_fullsized":"2024-05-12T22:56:48.746525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188577+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:56:51.188577+0000","last_peered":"2024-05-12T22:56:51.188577+0000","last_clean":"2024-05-12T22:56:51.188577+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:56:51.188577+0000","last_undegraded":"2024-05-12T22:56:51.188577+0000","last_fullsized":"2024-05-12T22:56:51.188577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'50","reported_seq":68,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.192438+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:56:51.192438+0000","last_peered":"2024-05-12T22:56:51.192438+0000","last_clean":"2024-05-12T22:56:51.192438+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:56:51.192438+0000","last_undegraded":"2024-05-12T22:56:51.192438+0000","last_fullsized":"2024-05-12T22:56:51.192438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":787597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.164394+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:56:51.164394+0000","last_peered":"2024-05-12T22:56:51.164394+0000","last_clean":"2024-05-12T22:56:51.164394+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:56:51.164394+0000","last_undegraded":"2024-05-12T22:56:51.164394+0000","last_fullsized":"2024-05-12T22:56:51.164394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:15.613646+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:54:15.613646+0000","last_peered":"2024-05-12T22:54:15.613646+0000","last_clean":"2024-05-12T22:54:15.613646+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:54:15.613646+0000","last_undegraded":"2024-05-12T22:54:15.613646+0000","last_fullsized":"2024-05-12T22:54:15.613646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169103+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:56:51.169103+0000","last_peered":"2024-05-12T22:56:51.169103+0000","last_clean":"2024-05-12T22:56:51.169103+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:56:51.169103+0000","last_undegraded":"2024-05-12T22:56:51.169103+0000","last_fullsized":"2024-05-12T22:56:51.169103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:24.626650+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:54:24.626650+0000","last_peered":"2024-05-12T22:54:24.626650+0000","last_clean":"2024-05-12T22:54:24.626650+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:54:24.626650+0000","last_undegraded":"2024-05-12T22:54:24.626650+0000","last_fullsized":"2024-05-12T22:54:24.626650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'20","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186680+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:56:51.186680+0000","last_peered":"2024-05-12T22:56:51.186680+0000","last_clean":"2024-05-12T22:56:51.186680+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:56:51.186680+0000","last_undegraded":"2024-05-12T22:56:51.186680+0000","last_fullsized":"2024-05-12T22:56:51.186680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632570+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:54:23.632570+0000","last_peered":"2024-05-12T22:54:23.632570+0000","last_clean":"2024-05-12T22:54:23.632570+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:54:23.632570+0000","last_undegraded":"2024-05-12T22:54:23.632570+0000","last_fullsized":"2024-05-12T22:54:23.632570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173281+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:56:51.173281+0000","last_peered":"2024-05-12T22:56:51.173281+0000","last_clean":"2024-05-12T22:56:51.173281+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:56:51.173281+0000","last_undegraded":"2024-05-12T22:56:51.173281+0000","last_fullsized":"2024-05-12T22:56:51.173281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:56.396852+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:54:56.396852+0000","last_peered":"2024-05-12T22:54:56.396852+0000","last_clean":"2024-05-12T22:54:56.396852+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:54:56.396852+0000","last_undegraded":"2024-05-12T22:54:56.396852+0000","last_fullsized":"2024-05-12T22:54:56.396852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176530+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:56:51.176530+0000","last_peered":"2024-05-12T22:56:51.176530+0000","last_clean":"2024-05-12T22:56:51.176530+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:56:51.176530+0000","last_undegraded":"2024-05-12T22:56:51.176530+0000","last_fullsized":"2024-05-12T22:56:51.176530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632749+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:54:23.632749+0000","last_peered":"2024-05-12T22:54:23.632749+0000","last_clean":"2024-05-12T22:54:23.632749+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:54:23.632749+0000","last_undegraded":"2024-05-12T22:54:23.632749+0000","last_fullsized":"2024-05-12T22:54:23.632749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176193+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:56:51.176193+0000","last_peered":"2024-05-12T22:56:51.176193+0000","last_clean":"2024-05-12T22:56:51.176193+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:56:51.176193+0000","last_undegraded":"2024-05-12T22:56:51.176193+0000","last_fullsized":"2024-05-12T22:56:51.176193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632760+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:54:23.632760+0000","last_peered":"2024-05-12T22:54:23.632760+0000","last_clean":"2024-05-12T22:54:23.632760+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:54:23.632760+0000","last_undegraded":"2024-05-12T22:54:23.632760+0000","last_fullsized":"2024-05-12T22:54:23.632760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184494+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:56:51.184494+0000","last_peered":"2024-05-12T22:56:51.184494+0000","last_clean":"2024-05-12T22:56:51.184494+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:56:51.184494+0000","last_undegraded":"2024-05-12T22:56:51.184494+0000","last_fullsized":"2024-05-12T22:56:51.184494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.635135+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:54:23.635135+0000","last_peered":"2024-05-12T22:54:23.635135+0000","last_clean":"2024-05-12T22:54:23.635135+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:54:23.635135+0000","last_undegraded":"2024-05-12T22:54:23.635135+0000","last_fullsized":"2024-05-12T22:54:23.635135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183640+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:56:51.183640+0000","last_peered":"2024-05-12T22:56:51.183640+0000","last_clean":"2024-05-12T22:56:51.183640+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:56:51.183640+0000","last_undegraded":"2024-05-12T22:56:51.183640+0000","last_fullsized":"2024-05-12T22:56:51.183640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:51.396109+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:54:51.396109+0000","last_peered":"2024-05-12T22:54:51.396109+0000","last_clean":"2024-05-12T22:54:51.396109+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:54:51.396109+0000","last_undegraded":"2024-05-12T22:54:51.396109+0000","last_fullsized":"2024-05-12T22:54:51.396109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183083+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:56:51.183083+0000","last_peered":"2024-05-12T22:56:51.183083+0000","last_clean":"2024-05-12T22:56:51.183083+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:56:51.183083+0000","last_undegraded":"2024-05-12T22:56:51.183083+0000","last_fullsized":"2024-05-12T22:56:51.183083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:22.393910+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:54:22.393910+0000","last_peered":"2024-05-12T22:54:22.393910+0000","last_clean":"2024-05-12T22:54:22.393910+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:54:22.393910+0000","last_undegraded":"2024-05-12T22:54:22.393910+0000","last_fullsized":"2024-05-12T22:54:22.393910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394617+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:54:42.394617+0000","last_peered":"2024-05-12T22:54:42.394617+0000","last_clean":"2024-05-12T22:54:42.394617+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:54:42.394617+0000","last_undegraded":"2024-05-12T22:54:42.394617+0000","last_fullsized":"2024-05-12T22:54:42.394617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178597+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:56:51.178597+0000","last_peered":"2024-05-12T22:56:51.178597+0000","last_clean":"2024-05-12T22:56:51.178597+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:56:51.178597+0000","last_undegraded":"2024-05-12T22:56:51.178597+0000","last_fullsized":"2024-05-12T22:56:51.178597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:37.396332+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:54:37.396332+0000","last_peered":"2024-05-12T22:54:37.396332+0000","last_clean":"2024-05-12T22:54:37.396332+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:54:37.396332+0000","last_undegraded":"2024-05-12T22:54:37.396332+0000","last_fullsized":"2024-05-12T22:54:37.396332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.117301+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:56:51.117301+0000","last_peered":"2024-05-12T22:56:51.117301+0000","last_clean":"2024-05-12T22:56:51.117301+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:56:51.117301+0000","last_undegraded":"2024-05-12T22:56:51.117301+0000","last_fullsized":"2024-05-12T22:56:51.117301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'20","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.736349+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:56:50.736349+0000","last_peered":"2024-05-12T22:56:50.736349+0000","last_clean":"2024-05-12T22:56:50.736349+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:56:50.736349+0000","last_undegraded":"2024-05-12T22:56:50.736349+0000","last_fullsized":"2024-05-12T22:56:50.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10908,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":14,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134952+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:56:51.134952+0000","last_peered":"2024-05-12T22:56:51.134952+0000","last_clean":"2024-05-12T22:56:51.134952+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:56:51.134952+0000","last_undegraded":"2024-05-12T22:56:51.134952+0000","last_fullsized":"2024-05-12T22:56:51.134952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394592+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:54:42.394592+0000","last_peered":"2024-05-12T22:54:42.394592+0000","last_clean":"2024-05-12T22:54:42.394592+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:54:42.394592+0000","last_undegraded":"2024-05-12T22:54:42.394592+0000","last_fullsized":"2024-05-12T22:54:42.394592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.145734+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:56:51.145734+0000","last_peered":"2024-05-12T22:56:51.145734+0000","last_clean":"2024-05-12T22:56:51.145734+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:56:51.145734+0000","last_undegraded":"2024-05-12T22:56:51.145734+0000","last_fullsized":"2024-05-12T22:56:51.145734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.383001+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:54:41.383001+0000","last_peered":"2024-05-12T22:54:41.383001+0000","last_clean":"2024-05-12T22:54:41.383001+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:54:41.383001+0000","last_undegraded":"2024-05-12T22:54:41.383001+0000","last_fullsized":"2024-05-12T22:54:41.383001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181791+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:56:51.181791+0000","last_peered":"2024-05-12T22:56:51.181791+0000","last_clean":"2024-05-12T22:56:51.181791+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:56:51.181791+0000","last_undegraded":"2024-05-12T22:56:51.181791+0000","last_fullsized":"2024-05-12T22:56:51.181791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.397237+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:54:42.397237+0000","last_peered":"2024-05-12T22:54:42.397237+0000","last_clean":"2024-05-12T22:54:42.397237+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:54:42.397237+0000","last_undegraded":"2024-05-12T22:54:42.397237+0000","last_fullsized":"2024-05-12T22:54:42.397237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133019+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:56:51.133019+0000","last_peered":"2024-05-12T22:56:51.133019+0000","last_clean":"2024-05-12T22:56:51.133019+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:56:51.133019+0000","last_undegraded":"2024-05-12T22:56:51.133019+0000","last_fullsized":"2024-05-12T22:56:51.133019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'42","reported_seq":62,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.569927+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:56:50.569927+0000","last_peered":"2024-05-12T22:56:50.569927+0000","last_clean":"2024-05-12T22:56:50.569927+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:56:50.569927+0000","last_undegraded":"2024-05-12T22:56:50.569927+0000","last_fullsized":"2024-05-12T22:56:50.569927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172431+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:56:51.172431+0000","last_peered":"2024-05-12T22:56:51.172431+0000","last_clean":"2024-05-12T22:56:51.172431+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:56:51.172431+0000","last_undegraded":"2024-05-12T22:56:51.172431+0000","last_fullsized":"2024-05-12T22:56:51.172431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.401513+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:54:47.401513+0000","last_peered":"2024-05-12T22:54:47.401513+0000","last_clean":"2024-05-12T22:54:47.401513+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:54:47.401513+0000","last_undegraded":"2024-05-12T22:54:47.401513+0000","last_fullsized":"2024-05-12T22:54:47.401513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136232+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:56:51.136232+0000","last_peered":"2024-05-12T22:56:51.136232+0000","last_clean":"2024-05-12T22:56:51.136232+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:56:51.136232+0000","last_undegraded":"2024-05-12T22:56:51.136232+0000","last_fullsized":"2024-05-12T22:56:51.136232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.398007+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:54:47.398007+0000","last_peered":"2024-05-12T22:54:47.398007+0000","last_clean":"2024-05-12T22:54:47.398007+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:54:47.398007+0000","last_undegraded":"2024-05-12T22:54:47.398007+0000","last_fullsized":"2024-05-12T22:54:47.398007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.149749+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:56:51.149749+0000","last_peered":"2024-05-12T22:56:51.149749+0000","last_clean":"2024-05-12T22:56:51.149749+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:56:51.149749+0000","last_undegraded":"2024-05-12T22:56:51.149749+0000","last_fullsized":"2024-05-12T22:56:51.149749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383776+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:54:46.383776+0000","last_peered":"2024-05-12T22:54:46.383776+0000","last_clean":"2024-05-12T22:54:46.383776+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:54:46.383776+0000","last_undegraded":"2024-05-12T22:54:46.383776+0000","last_fullsized":"2024-05-12T22:54:46.383776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136855+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:56:51.136855+0000","last_peered":"2024-05-12T22:56:51.136855+0000","last_clean":"2024-05-12T22:56:51.136855+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:56:51.136855+0000","last_undegraded":"2024-05-12T22:56:51.136855+0000","last_fullsized":"2024-05-12T22:56:51.136855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383820+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:54:46.383820+0000","last_peered":"2024-05-12T22:54:46.383820+0000","last_clean":"2024-05-12T22:54:46.383820+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:54:46.383820+0000","last_undegraded":"2024-05-12T22:54:46.383820+0000","last_fullsized":"2024-05-12T22:54:46.383820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136287+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:56:51.136287+0000","last_peered":"2024-05-12T22:56:51.136287+0000","last_clean":"2024-05-12T22:56:51.136287+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:56:51.136287+0000","last_undegraded":"2024-05-12T22:56:51.136287+0000","last_fullsized":"2024-05-12T22:56:51.136287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632252+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:54:23.632252+0000","last_peered":"2024-05-12T22:54:23.632252+0000","last_clean":"2024-05-12T22:54:23.632252+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:54:23.632252+0000","last_undegraded":"2024-05-12T22:54:23.632252+0000","last_fullsized":"2024-05-12T22:54:23.632252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176624+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:56:51.176624+0000","last_peered":"2024-05-12T22:56:51.176624+0000","last_clean":"2024-05-12T22:56:51.176624+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:56:51.176624+0000","last_undegraded":"2024-05-12T22:56:51.176624+0000","last_fullsized":"2024-05-12T22:56:51.176624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'14","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186756+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:56:51.186756+0000","last_peered":"2024-05-12T22:56:51.186756+0000","last_clean":"2024-05-12T22:56:51.186756+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:56:51.186756+0000","last_undegraded":"2024-05-12T22:56:51.186756+0000","last_fullsized":"2024-05-12T22:56:51.186756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:55:07.401253+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:55:07.401253+0000","last_peered":"2024-05-12T22:55:07.401253+0000","last_clean":"2024-05-12T22:55:07.401253+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:55:07.401253+0000","last_undegraded":"2024-05-12T22:55:07.401253+0000","last_fullsized":"2024-05-12T22:55:07.401253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146145+0000","last_change":"2024-05-12T22:53:16.700551+0000","last_active":"2024-05-12T22:56:51.146145+0000","last_peered":"2024-05-12T22:56:51.146145+0000","last_clean":"2024-05-12T22:56:51.146145+0000","last_became_active":"2024-05-12T22:53:16.699663+0000","last_became_peered":"2024-05-12T22:53:16.699663+0000","last_unstale":"2024-05-12T22:56:51.146145+0000","last_undegraded":"2024-05-12T22:56:51.146145+0000","last_fullsized":"2024-05-12T22:56:51.146145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:07:49.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.634053+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:54:20.634053+0000","last_peered":"2024-05-12T22:54:20.634053+0000","last_clean":"2024-05-12T22:54:20.634053+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:54:20.634053+0000","last_undegraded":"2024-05-12T22:54:20.634053+0000","last_fullsized":"2024-05-12T22:54:20.634053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147074+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:56:51.147074+0000","last_peered":"2024-05-12T22:56:51.147074+0000","last_clean":"2024-05-12T22:56:51.147074+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:56:51.147074+0000","last_undegraded":"2024-05-12T22:56:51.147074+0000","last_fullsized":"2024-05-12T22:56:51.147074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:36.393165+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:54:36.393165+0000","last_peered":"2024-05-12T22:54:36.393165+0000","last_clean":"2024-05-12T22:54:36.393165+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:54:36.393165+0000","last_undegraded":"2024-05-12T22:54:36.393165+0000","last_fullsized":"2024-05-12T22:54:36.393165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178191+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:56:51.178191+0000","last_peered":"2024-05-12T22:56:51.178191+0000","last_clean":"2024-05-12T22:56:51.178191+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:56:51.178191+0000","last_undegraded":"2024-05-12T22:56:51.178191+0000","last_fullsized":"2024-05-12T22:56:51.178191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.406554+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:54:41.406554+0000","last_peered":"2024-05-12T22:54:41.406554+0000","last_clean":"2024-05-12T22:54:41.406554+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:54:41.406554+0000","last_undegraded":"2024-05-12T22:54:41.406554+0000","last_fullsized":"2024-05-12T22:54:41.406554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":799303,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":179,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":1598606,"data_compressed":229594,"data_compressed_allocated":278528,"data_compressed_original":1400832,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":675733,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":872380,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":84873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":883288,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":95691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":675789,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":798505,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":787597,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:56:57.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:56:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.008+0000 7f84c6a7d640 1 Processor -- start 2024-05-12T22:56:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.008+0000 7f84c6a7d640 1 -- start start 2024-05-12T22:56:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84c00bd800 0x7f84c01476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 0x7f84c01411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c0148040 con 0x7f84c0141720 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00bdbe0 con 0x7f84c00bd800 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f84c00b6f40 con 0x7f84c0147be0 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84c00bd800 0x7f84c01476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84c00bd800 0x7f84c01476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60448/0 (socket says 172.21.15.40:60448) 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 -- 172.21.15.40:0/38438303 learned_addr learned my addr 172.21.15.40:0/38438303 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84bffff640 1 --2- 172.21.15.40:0/38438303 >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 0x7f84c01411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 -- 172.21.15.40:0/38438303 >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 msgr2=0x7f84c01411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 --2- 172.21.15.40:0/38438303 >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 0x7f84c01411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 -- 172.21.15.40:0/38438303 >> v1:172.21.15.47:6789/0 conn(0x7f84c0141720 legacy=0x7f84c00b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 -- 172.21.15.40:0/38438303 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c00b56e0 con 0x7f84c00bd800 2024-05-12T22:56:58.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84bffff640 1 --2- 172.21.15.40:0/38438303 >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 0x7f84c01411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:58.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c4819640 1 --2- 172.21.15.40:0/38438303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c00bd800 0x7f84c01476a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84c00b94a0 tx=0x7f84a801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75e33dd95cb64e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84bf7fe640 1 -- 172.21.15.40:0/38438303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80b0070 con 0x7f84c00bd800 2024-05-12T22:56:58.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84bf7fe640 1 -- 172.21.15.40:0/38438303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a80ab600 con 0x7f84c00bd800 2024-05-12T22:56:58.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84bf7fe640 1 -- 172.21.15.40:0/38438303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80ab9d0 con 0x7f84c00bd800 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 -- 172.21.15.40:0/38438303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c00bd800 msgr2=0x7f84c01476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/38438303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c00bd800 0x7f84c01476a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84c00b94a0 tx=0x7f84a801c3c0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 -- 172.21.15.40:0/38438303 shutdown_connections 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/38438303 >> v2:172.21.15.47:3300/0 conn(0x7f84c0147be0 0x7f84c01411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.012+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/38438303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c00bd800 0x7f84c01476a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/38438303 >> 172.21.15.40:0/38438303 conn(0x7f84c0072ff0 msgr2=0x7f84c00bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/38438303 shutdown_connections 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/38438303 wait complete. 2024-05-12T22:56:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 Processor -- start 2024-05-12T22:56:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- start start 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 0x7f84c013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 0x7f84c013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00b9690 con 0x7f84c0147be0 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84c00b9510 con 0x7f84c0141720 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f84c00b44e0 con 0x7f84c00bd800 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60456/0 (socket says 172.21.15.40:60456) 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 -- 172.21.15.40:0/3269538304 learned_addr learned my addr 172.21.15.40:0/3269538304 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c4819640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 0x7f84c013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84bffff640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 0x7f84c013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 -- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 msgr2=0x7f84c013fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 0x7f84c013fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 -- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 msgr2=0x7f84c013a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 0x7f84c013a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 -- 172.21.15.40:0/3269538304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0139cd0 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84bffff640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 0x7f84c013a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c4819640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 0x7f84c013fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c501a640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c3c0 tx=0x7f84b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011790 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b8017070 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c013c430 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011b70 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c0139f70 con 0x7f84c0147be0 2024-05-12T22:56:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.016+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0068330 con 0x7f84c0147be0 2024-05-12T22:56:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.020+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84b8011d10 con 0x7f84c0147be0 2024-05-12T22:56:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.020+0000 7f84bd7fa640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.020+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f84b8085a30 con 0x7f84c0147be0 2024-05-12T22:56:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.020+0000 7f84c4819640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.020+0000 7f84c4819640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 0x7f84a4069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.024+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f84b8056580 con 0x7f84c0147be0 2024-05-12T22:56:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.184+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84c00678d0 con 0x7f84a40678c0 2024-05-12T22:56:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.192+0000 7f84bd7fa640 1 -- 172.21.15.40:0/3269538304 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252208 (secure 0 0 0) 0x7f84c00678d0 con 0x7f84a40678c0 2024-05-12T22:56:58.199 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 msgr2=0x7f84a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 0x7f84a4069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a8008040 comp rx=0 tx=0).stop 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 msgr2=0x7f84c01e2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c3c0 tx=0x7f84b800c880 comp rx=0 tx=0).stop 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 shutdown_connections 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84c0147be0 0x7f84c01e2c80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f84a40678c0 0x7f84a4069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84c0141720 0x7f84c013a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 --2- 172.21.15.40:0/3269538304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f84c00bd800 0x7f84c013fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 >> 172.21.15.40:0/3269538304 conn(0x7f84c0072ff0 msgr2=0x7f84c0074220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 shutdown_connections 2024-05-12T22:56:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.200+0000 7f84c6a7d640 1 -- 172.21.15.40:0/3269538304 wait complete. 2024-05-12T22:56:58.219 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-05-12T22:56:57.426980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389671,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":344,"num_write_kb":3287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":871,"ondisk_log_size":871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239408,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754735312,"statfs":{"total":773094113280,"available":772848959488,"internally_reserved":0,"allocated":2539520,"data_stored":3457606,"data_compressed":296616,"data_compressed_allocated":368640,"data_compressed_original":2547712,"omap_allocated":12747,"internal_metadata":242535989},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31297,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":29,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003805"},"pg_stats":[{"pgid":"3.3f","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.177666+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:56:51.177666+0000","last_peered":"2024-05-12T22:56:51.177666+0000","last_clean":"2024-05-12T22:56:51.177666+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:56:51.177666+0000","last_undegraded":"2024-05-12T22:56:51.177666+0000","last_fullsized":"2024-05-12T22:56:51.177666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137815+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:56:51.137815+0000","last_peered":"2024-05-12T22:56:51.137815+0000","last_clean":"2024-05-12T22:56:51.137815+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:56:51.137815+0000","last_undegraded":"2024-05-12T22:56:51.137815+0000","last_fullsized":"2024-05-12T22:56:51.137815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133288+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:56:51.133288+0000","last_peered":"2024-05-12T22:56:51.133288+0000","last_clean":"2024-05-12T22:56:51.133288+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:56:51.133288+0000","last_undegraded":"2024-05-12T22:56:51.133288+0000","last_fullsized":"2024-05-12T22:56:51.133288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183765+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:56:51.183765+0000","last_peered":"2024-05-12T22:56:51.183765+0000","last_clean":"2024-05-12T22:56:51.183765+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:56:51.183765+0000","last_undegraded":"2024-05-12T22:56:51.183765+0000","last_fullsized":"2024-05-12T22:56:51.183765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186544+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:56:51.186544+0000","last_peered":"2024-05-12T22:56:51.186544+0000","last_clean":"2024-05-12T22:56:51.186544+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:56:51.186544+0000","last_undegraded":"2024-05-12T22:56:51.186544+0000","last_fullsized":"2024-05-12T22:56:51.186544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182874+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:56:51.182874+0000","last_peered":"2024-05-12T22:56:51.182874+0000","last_clean":"2024-05-12T22:56:51.182874+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:56:51.182874+0000","last_undegraded":"2024-05-12T22:56:51.182874+0000","last_fullsized":"2024-05-12T22:56:51.182874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.166324+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:56:51.166324+0000","last_peered":"2024-05-12T22:56:51.166324+0000","last_clean":"2024-05-12T22:56:51.166324+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:56:51.166324+0000","last_undegraded":"2024-05-12T22:56:51.166324+0000","last_fullsized":"2024-05-12T22:56:51.166324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178881+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:56:51.178881+0000","last_peered":"2024-05-12T22:56:51.178881+0000","last_clean":"2024-05-12T22:56:51.178881+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:56:51.178881+0000","last_undegraded":"2024-05-12T22:56:51.178881+0000","last_fullsized":"2024-05-12T22:56:51.178881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.180668+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:56:51.180668+0000","last_peered":"2024-05-12T22:56:51.180668+0000","last_clean":"2024-05-12T22:56:51.180668+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:56:51.180668+0000","last_undegraded":"2024-05-12T22:56:51.180668+0000","last_fullsized":"2024-05-12T22:56:51.180668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'16","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188935+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:56:51.188935+0000","last_peered":"2024-05-12T22:56:51.188935+0000","last_clean":"2024-05-12T22:56:51.188935+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:56:51.188935+0000","last_undegraded":"2024-05-12T22:56:51.188935+0000","last_fullsized":"2024-05-12T22:56:51.188935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182310+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:56:51.182310+0000","last_peered":"2024-05-12T22:56:51.182310+0000","last_clean":"2024-05-12T22:56:51.182310+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:56:51.182310+0000","last_undegraded":"2024-05-12T22:56:51.182310+0000","last_fullsized":"2024-05-12T22:56:51.182310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179011+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:56:51.179011+0000","last_peered":"2024-05-12T22:56:51.179011+0000","last_clean":"2024-05-12T22:56:51.179011+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:56:51.179011+0000","last_undegraded":"2024-05-12T22:56:51.179011+0000","last_fullsized":"2024-05-12T22:56:51.179011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173134+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:56:51.173134+0000","last_peered":"2024-05-12T22:56:51.173134+0000","last_clean":"2024-05-12T22:56:51.173134+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:56:51.173134+0000","last_undegraded":"2024-05-12T22:56:51.173134+0000","last_fullsized":"2024-05-12T22:56:51.173134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.120262+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:56:51.120262+0000","last_peered":"2024-05-12T22:56:51.120262+0000","last_clean":"2024-05-12T22:56:51.120262+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:56:51.120262+0000","last_undegraded":"2024-05-12T22:56:51.120262+0000","last_fullsized":"2024-05-12T22:56:51.120262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.171392+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:56:51.171392+0000","last_peered":"2024-05-12T22:56:51.171392+0000","last_clean":"2024-05-12T22:56:51.171392+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:56:51.171392+0000","last_undegraded":"2024-05-12T22:56:51.171392+0000","last_fullsized":"2024-05-12T22:56:51.171392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'11","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.128437+0000","last_change":"2024-05-12T22:53:16.797441+0000","last_active":"2024-05-12T22:56:51.128437+0000","last_peered":"2024-05-12T22:56:51.128437+0000","last_clean":"2024-05-12T22:56:51.128437+0000","last_became_active":"2024-05-12T22:53:16.796573+0000","last_became_peered":"2024-05-12T22:53:16.796573+0000","last_unstale":"2024-05-12T22:56:51.128437+0000","last_undegraded":"2024-05-12T22:56:51.128437+0000","last_fullsized":"2024-05-12T22:56:51.128437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:00:31.347895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179157+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:56:51.179157+0000","last_peered":"2024-05-12T22:56:51.179157+0000","last_clean":"2024-05-12T22:56:51.179157+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:56:51.179157+0000","last_undegraded":"2024-05-12T22:56:51.179157+0000","last_fullsized":"2024-05-12T22:56:51.179157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172422+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:56:51.172422+0000","last_peered":"2024-05-12T22:56:51.172422+0000","last_clean":"2024-05-12T22:56:51.172422+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:56:51.172422+0000","last_undegraded":"2024-05-12T22:56:51.172422+0000","last_fullsized":"2024-05-12T22:56:51.172422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.168264+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:56:51.168264+0000","last_peered":"2024-05-12T22:56:51.168264+0000","last_clean":"2024-05-12T22:56:51.168264+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:56:51.168264+0000","last_undegraded":"2024-05-12T22:56:51.168264+0000","last_fullsized":"2024-05-12T22:56:51.168264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184335+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:56:51.184335+0000","last_peered":"2024-05-12T22:56:51.184335+0000","last_clean":"2024-05-12T22:56:51.184335+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:56:51.184335+0000","last_undegraded":"2024-05-12T22:56:51.184335+0000","last_fullsized":"2024-05-12T22:56:51.184335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.189517+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:56:51.189517+0000","last_peered":"2024-05-12T22:56:51.189517+0000","last_clean":"2024-05-12T22:56:51.189517+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:56:51.189517+0000","last_undegraded":"2024-05-12T22:56:51.189517+0000","last_fullsized":"2024-05-12T22:56:51.189517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186658+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:56:51.186658+0000","last_peered":"2024-05-12T22:56:51.186658+0000","last_clean":"2024-05-12T22:56:51.186658+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:56:51.186658+0000","last_undegraded":"2024-05-12T22:56:51.186658+0000","last_fullsized":"2024-05-12T22:56:51.186658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146422+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:56:51.146422+0000","last_peered":"2024-05-12T22:56:51.146422+0000","last_clean":"2024-05-12T22:56:51.146422+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:56:51.146422+0000","last_undegraded":"2024-05-12T22:56:51.146422+0000","last_fullsized":"2024-05-12T22:56:51.146422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181469+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:56:51.181469+0000","last_peered":"2024-05-12T22:56:51.181469+0000","last_clean":"2024-05-12T22:56:51.181469+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:56:51.181469+0000","last_undegraded":"2024-05-12T22:56:51.181469+0000","last_fullsized":"2024-05-12T22:56:51.181469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.151233+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:56:51.151233+0000","last_peered":"2024-05-12T22:56:51.151233+0000","last_clean":"2024-05-12T22:56:51.151233+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:56:51.151233+0000","last_undegraded":"2024-05-12T22:56:51.151233+0000","last_fullsized":"2024-05-12T22:56:51.151233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188917+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:56:51.188917+0000","last_peered":"2024-05-12T22:56:51.188917+0000","last_clean":"2024-05-12T22:56:51.188917+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:56:51.188917+0000","last_undegraded":"2024-05-12T22:56:51.188917+0000","last_fullsized":"2024-05-12T22:56:51.188917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133086+0000","last_change":"2024-05-12T22:53:16.705033+0000","last_active":"2024-05-12T22:56:51.133086+0000","last_peered":"2024-05-12T22:56:51.133086+0000","last_clean":"2024-05-12T22:56:51.133086+0000","last_became_active":"2024-05-12T22:53:16.704085+0000","last_became_peered":"2024-05-12T22:53:16.704085+0000","last_unstale":"2024-05-12T22:56:51.133086+0000","last_undegraded":"2024-05-12T22:56:51.133086+0000","last_fullsized":"2024-05-12T22:56:51.133086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:11:57.355073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.175677+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:56:51.175677+0000","last_peered":"2024-05-12T22:56:51.175677+0000","last_clean":"2024-05-12T22:56:51.175677+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:56:51.175677+0000","last_undegraded":"2024-05-12T22:56:51.175677+0000","last_fullsized":"2024-05-12T22:56:51.175677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.131434+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:56:51.131434+0000","last_peered":"2024-05-12T22:56:51.131434+0000","last_clean":"2024-05-12T22:56:51.131434+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:56:51.131434+0000","last_undegraded":"2024-05-12T22:56:51.131434+0000","last_fullsized":"2024-05-12T22:56:51.131434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183211+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:56:51.183211+0000","last_peered":"2024-05-12T22:56:51.183211+0000","last_clean":"2024-05-12T22:56:51.183211+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:56:51.183211+0000","last_undegraded":"2024-05-12T22:56:51.183211+0000","last_fullsized":"2024-05-12T22:56:51.183211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.130751+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:56:51.130751+0000","last_peered":"2024-05-12T22:56:51.130751+0000","last_clean":"2024-05-12T22:56:51.130751+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:56:51.130751+0000","last_undegraded":"2024-05-12T22:56:51.130751+0000","last_fullsized":"2024-05-12T22:56:51.130751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.162196+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:56:51.162196+0000","last_peered":"2024-05-12T22:56:51.162196+0000","last_clean":"2024-05-12T22:56:51.162196+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:56:51.162196+0000","last_undegraded":"2024-05-12T22:56:51.162196+0000","last_fullsized":"2024-05-12T22:56:51.162196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146258+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:56:51.146258+0000","last_peered":"2024-05-12T22:56:51.146258+0000","last_clean":"2024-05-12T22:56:51.146258+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:56:51.146258+0000","last_undegraded":"2024-05-12T22:56:51.146258+0000","last_fullsized":"2024-05-12T22:56:51.146258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.628217+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:54:20.628217+0000","last_peered":"2024-05-12T22:54:20.628217+0000","last_clean":"2024-05-12T22:54:20.628217+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:54:20.628217+0000","last_undegraded":"2024-05-12T22:54:20.628217+0000","last_fullsized":"2024-05-12T22:54:20.628217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.142227+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:56:51.142227+0000","last_peered":"2024-05-12T22:56:51.142227+0000","last_clean":"2024-05-12T22:56:51.142227+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:56:51.142227+0000","last_undegraded":"2024-05-12T22:56:51.142227+0000","last_fullsized":"2024-05-12T22:56:51.142227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.632005+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:54:20.632005+0000","last_peered":"2024-05-12T22:54:20.632005+0000","last_clean":"2024-05-12T22:54:20.632005+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:54:20.632005+0000","last_undegraded":"2024-05-12T22:54:20.632005+0000","last_fullsized":"2024-05-12T22:54:20.632005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.636641+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:54:23.636641+0000","last_peered":"2024-05-12T22:54:23.636641+0000","last_clean":"2024-05-12T22:54:23.636641+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:54:23.636641+0000","last_undegraded":"2024-05-12T22:54:23.636641+0000","last_fullsized":"2024-05-12T22:54:23.636641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134633+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:56:51.134633+0000","last_peered":"2024-05-12T22:56:51.134633+0000","last_clean":"2024-05-12T22:56:51.134633+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:56:51.134633+0000","last_undegraded":"2024-05-12T22:56:51.134633+0000","last_fullsized":"2024-05-12T22:56:51.134633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.633590+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:54:23.633590+0000","last_peered":"2024-05-12T22:54:23.633590+0000","last_clean":"2024-05-12T22:54:23.633590+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:54:23.633590+0000","last_undegraded":"2024-05-12T22:54:23.633590+0000","last_fullsized":"2024-05-12T22:54:23.633590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137927+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:56:51.137927+0000","last_peered":"2024-05-12T22:56:51.137927+0000","last_clean":"2024-05-12T22:56:51.137927+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:56:51.137927+0000","last_undegraded":"2024-05-12T22:56:51.137927+0000","last_fullsized":"2024-05-12T22:56:51.137927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.631837+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:54:23.631837+0000","last_peered":"2024-05-12T22:54:23.631837+0000","last_clean":"2024-05-12T22:54:23.631837+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:54:23.631837+0000","last_undegraded":"2024-05-12T22:54:23.631837+0000","last_fullsized":"2024-05-12T22:54:23.631837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169465+0000","last_change":"2024-05-12T22:53:16.797487+0000","last_active":"2024-05-12T22:56:51.169465+0000","last_peered":"2024-05-12T22:56:51.169465+0000","last_clean":"2024-05-12T22:56:51.169465+0000","last_became_active":"2024-05-12T22:53:16.796547+0000","last_became_peered":"2024-05-12T22:53:16.796547+0000","last_unstale":"2024-05-12T22:56:51.169465+0000","last_undegraded":"2024-05-12T22:56:51.169465+0000","last_fullsized":"2024-05-12T22:56:51.169465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:06:32.862154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.634995+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:54:23.634995+0000","last_peered":"2024-05-12T22:54:23.634995+0000","last_clean":"2024-05-12T22:54:23.634995+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:54:23.634995+0000","last_undegraded":"2024-05-12T22:54:23.634995+0000","last_fullsized":"2024-05-12T22:54:23.634995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147092+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:56:51.147092+0000","last_peered":"2024-05-12T22:56:51.147092+0000","last_clean":"2024-05-12T22:56:51.147092+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:56:51.147092+0000","last_undegraded":"2024-05-12T22:56:51.147092+0000","last_fullsized":"2024-05-12T22:56:51.147092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'15","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:48.746525+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:56:48.746525+0000","last_peered":"2024-05-12T22:56:48.746525+0000","last_clean":"2024-05-12T22:56:48.746525+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:56:48.746525+0000","last_undegraded":"2024-05-12T22:56:48.746525+0000","last_fullsized":"2024-05-12T22:56:48.746525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188577+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:56:51.188577+0000","last_peered":"2024-05-12T22:56:51.188577+0000","last_clean":"2024-05-12T22:56:51.188577+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:56:51.188577+0000","last_undegraded":"2024-05-12T22:56:51.188577+0000","last_fullsized":"2024-05-12T22:56:51.188577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'50","reported_seq":68,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.192438+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:56:51.192438+0000","last_peered":"2024-05-12T22:56:51.192438+0000","last_clean":"2024-05-12T22:56:51.192438+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:56:51.192438+0000","last_undegraded":"2024-05-12T22:56:51.192438+0000","last_fullsized":"2024-05-12T22:56:51.192438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":787597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.164394+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:56:51.164394+0000","last_peered":"2024-05-12T22:56:51.164394+0000","last_clean":"2024-05-12T22:56:51.164394+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:56:51.164394+0000","last_undegraded":"2024-05-12T22:56:51.164394+0000","last_fullsized":"2024-05-12T22:56:51.164394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:15.613646+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:54:15.613646+0000","last_peered":"2024-05-12T22:54:15.613646+0000","last_clean":"2024-05-12T22:54:15.613646+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:54:15.613646+0000","last_undegraded":"2024-05-12T22:54:15.613646+0000","last_fullsized":"2024-05-12T22:54:15.613646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169103+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:56:51.169103+0000","last_peered":"2024-05-12T22:56:51.169103+0000","last_clean":"2024-05-12T22:56:51.169103+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:56:51.169103+0000","last_undegraded":"2024-05-12T22:56:51.169103+0000","last_fullsized":"2024-05-12T22:56:51.169103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:24.626650+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:54:24.626650+0000","last_peered":"2024-05-12T22:54:24.626650+0000","last_clean":"2024-05-12T22:54:24.626650+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:54:24.626650+0000","last_undegraded":"2024-05-12T22:54:24.626650+0000","last_fullsized":"2024-05-12T22:54:24.626650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'20","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186680+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:56:51.186680+0000","last_peered":"2024-05-12T22:56:51.186680+0000","last_clean":"2024-05-12T22:56:51.186680+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:56:51.186680+0000","last_undegraded":"2024-05-12T22:56:51.186680+0000","last_fullsized":"2024-05-12T22:56:51.186680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632570+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:54:23.632570+0000","last_peered":"2024-05-12T22:54:23.632570+0000","last_clean":"2024-05-12T22:54:23.632570+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:54:23.632570+0000","last_undegraded":"2024-05-12T22:54:23.632570+0000","last_fullsized":"2024-05-12T22:54:23.632570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173281+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:56:51.173281+0000","last_peered":"2024-05-12T22:56:51.173281+0000","last_clean":"2024-05-12T22:56:51.173281+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:56:51.173281+0000","last_undegraded":"2024-05-12T22:56:51.173281+0000","last_fullsized":"2024-05-12T22:56:51.173281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:56.396852+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:54:56.396852+0000","last_peered":"2024-05-12T22:54:56.396852+0000","last_clean":"2024-05-12T22:54:56.396852+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:54:56.396852+0000","last_undegraded":"2024-05-12T22:54:56.396852+0000","last_fullsized":"2024-05-12T22:54:56.396852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176530+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:56:51.176530+0000","last_peered":"2024-05-12T22:56:51.176530+0000","last_clean":"2024-05-12T22:56:51.176530+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:56:51.176530+0000","last_undegraded":"2024-05-12T22:56:51.176530+0000","last_fullsized":"2024-05-12T22:56:51.176530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632749+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:54:23.632749+0000","last_peered":"2024-05-12T22:54:23.632749+0000","last_clean":"2024-05-12T22:54:23.632749+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:54:23.632749+0000","last_undegraded":"2024-05-12T22:54:23.632749+0000","last_fullsized":"2024-05-12T22:54:23.632749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176193+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:56:51.176193+0000","last_peered":"2024-05-12T22:56:51.176193+0000","last_clean":"2024-05-12T22:56:51.176193+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:56:51.176193+0000","last_undegraded":"2024-05-12T22:56:51.176193+0000","last_fullsized":"2024-05-12T22:56:51.176193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632760+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:54:23.632760+0000","last_peered":"2024-05-12T22:54:23.632760+0000","last_clean":"2024-05-12T22:54:23.632760+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:54:23.632760+0000","last_undegraded":"2024-05-12T22:54:23.632760+0000","last_fullsized":"2024-05-12T22:54:23.632760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184494+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:56:51.184494+0000","last_peered":"2024-05-12T22:56:51.184494+0000","last_clean":"2024-05-12T22:56:51.184494+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:56:51.184494+0000","last_undegraded":"2024-05-12T22:56:51.184494+0000","last_fullsized":"2024-05-12T22:56:51.184494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.635135+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:54:23.635135+0000","last_peered":"2024-05-12T22:54:23.635135+0000","last_clean":"2024-05-12T22:54:23.635135+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:54:23.635135+0000","last_undegraded":"2024-05-12T22:54:23.635135+0000","last_fullsized":"2024-05-12T22:54:23.635135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183640+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:56:51.183640+0000","last_peered":"2024-05-12T22:56:51.183640+0000","last_clean":"2024-05-12T22:56:51.183640+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:56:51.183640+0000","last_undegraded":"2024-05-12T22:56:51.183640+0000","last_fullsized":"2024-05-12T22:56:51.183640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:51.396109+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:54:51.396109+0000","last_peered":"2024-05-12T22:54:51.396109+0000","last_clean":"2024-05-12T22:54:51.396109+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:54:51.396109+0000","last_undegraded":"2024-05-12T22:54:51.396109+0000","last_fullsized":"2024-05-12T22:54:51.396109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183083+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:56:51.183083+0000","last_peered":"2024-05-12T22:56:51.183083+0000","last_clean":"2024-05-12T22:56:51.183083+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:56:51.183083+0000","last_undegraded":"2024-05-12T22:56:51.183083+0000","last_fullsized":"2024-05-12T22:56:51.183083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:22.393910+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:54:22.393910+0000","last_peered":"2024-05-12T22:54:22.393910+0000","last_clean":"2024-05-12T22:54:22.393910+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:54:22.393910+0000","last_undegraded":"2024-05-12T22:54:22.393910+0000","last_fullsized":"2024-05-12T22:54:22.393910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394617+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:54:42.394617+0000","last_peered":"2024-05-12T22:54:42.394617+0000","last_clean":"2024-05-12T22:54:42.394617+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:54:42.394617+0000","last_undegraded":"2024-05-12T22:54:42.394617+0000","last_fullsized":"2024-05-12T22:54:42.394617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178597+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:56:51.178597+0000","last_peered":"2024-05-12T22:56:51.178597+0000","last_clean":"2024-05-12T22:56:51.178597+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:56:51.178597+0000","last_undegraded":"2024-05-12T22:56:51.178597+0000","last_fullsized":"2024-05-12T22:56:51.178597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:37.396332+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:54:37.396332+0000","last_peered":"2024-05-12T22:54:37.396332+0000","last_clean":"2024-05-12T22:54:37.396332+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:54:37.396332+0000","last_undegraded":"2024-05-12T22:54:37.396332+0000","last_fullsized":"2024-05-12T22:54:37.396332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.117301+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:56:51.117301+0000","last_peered":"2024-05-12T22:56:51.117301+0000","last_clean":"2024-05-12T22:56:51.117301+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:56:51.117301+0000","last_undegraded":"2024-05-12T22:56:51.117301+0000","last_fullsized":"2024-05-12T22:56:51.117301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'20","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.736349+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:56:50.736349+0000","last_peered":"2024-05-12T22:56:50.736349+0000","last_clean":"2024-05-12T22:56:50.736349+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:56:50.736349+0000","last_undegraded":"2024-05-12T22:56:50.736349+0000","last_fullsized":"2024-05-12T22:56:50.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10908,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":14,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134952+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:56:51.134952+0000","last_peered":"2024-05-12T22:56:51.134952+0000","last_clean":"2024-05-12T22:56:51.134952+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:56:51.134952+0000","last_undegraded":"2024-05-12T22:56:51.134952+0000","last_fullsized":"2024-05-12T22:56:51.134952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394592+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:54:42.394592+0000","last_peered":"2024-05-12T22:54:42.394592+0000","last_clean":"2024-05-12T22:54:42.394592+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:54:42.394592+0000","last_undegraded":"2024-05-12T22:54:42.394592+0000","last_fullsized":"2024-05-12T22:54:42.394592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.145734+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:56:51.145734+0000","last_peered":"2024-05-12T22:56:51.145734+0000","last_clean":"2024-05-12T22:56:51.145734+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:56:51.145734+0000","last_undegraded":"2024-05-12T22:56:51.145734+0000","last_fullsized":"2024-05-12T22:56:51.145734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.383001+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:54:41.383001+0000","last_peered":"2024-05-12T22:54:41.383001+0000","last_clean":"2024-05-12T22:54:41.383001+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:54:41.383001+0000","last_undegraded":"2024-05-12T22:54:41.383001+0000","last_fullsized":"2024-05-12T22:54:41.383001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181791+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:56:51.181791+0000","last_peered":"2024-05-12T22:56:51.181791+0000","last_clean":"2024-05-12T22:56:51.181791+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:56:51.181791+0000","last_undegraded":"2024-05-12T22:56:51.181791+0000","last_fullsized":"2024-05-12T22:56:51.181791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.397237+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:54:42.397237+0000","last_peered":"2024-05-12T22:54:42.397237+0000","last_clean":"2024-05-12T22:54:42.397237+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:54:42.397237+0000","last_undegraded":"2024-05-12T22:54:42.397237+0000","last_fullsized":"2024-05-12T22:54:42.397237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133019+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:56:51.133019+0000","last_peered":"2024-05-12T22:56:51.133019+0000","last_clean":"2024-05-12T22:56:51.133019+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:56:51.133019+0000","last_undegraded":"2024-05-12T22:56:51.133019+0000","last_fullsized":"2024-05-12T22:56:51.133019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'42","reported_seq":62,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.569927+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:56:50.569927+0000","last_peered":"2024-05-12T22:56:50.569927+0000","last_clean":"2024-05-12T22:56:50.569927+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:56:50.569927+0000","last_undegraded":"2024-05-12T22:56:50.569927+0000","last_fullsized":"2024-05-12T22:56:50.569927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172431+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:56:51.172431+0000","last_peered":"2024-05-12T22:56:51.172431+0000","last_clean":"2024-05-12T22:56:51.172431+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:56:51.172431+0000","last_undegraded":"2024-05-12T22:56:51.172431+0000","last_fullsized":"2024-05-12T22:56:51.172431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.401513+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:54:47.401513+0000","last_peered":"2024-05-12T22:54:47.401513+0000","last_clean":"2024-05-12T22:54:47.401513+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:54:47.401513+0000","last_undegraded":"2024-05-12T22:54:47.401513+0000","last_fullsized":"2024-05-12T22:54:47.401513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136232+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:56:51.136232+0000","last_peered":"2024-05-12T22:56:51.136232+0000","last_clean":"2024-05-12T22:56:51.136232+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:56:51.136232+0000","last_undegraded":"2024-05-12T22:56:51.136232+0000","last_fullsized":"2024-05-12T22:56:51.136232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.398007+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:54:47.398007+0000","last_peered":"2024-05-12T22:54:47.398007+0000","last_clean":"2024-05-12T22:54:47.398007+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:54:47.398007+0000","last_undegraded":"2024-05-12T22:54:47.398007+0000","last_fullsized":"2024-05-12T22:54:47.398007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.149749+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:56:51.149749+0000","last_peered":"2024-05-12T22:56:51.149749+0000","last_clean":"2024-05-12T22:56:51.149749+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:56:51.149749+0000","last_undegraded":"2024-05-12T22:56:51.149749+0000","last_fullsized":"2024-05-12T22:56:51.149749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383776+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:54:46.383776+0000","last_peered":"2024-05-12T22:54:46.383776+0000","last_clean":"2024-05-12T22:54:46.383776+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:54:46.383776+0000","last_undegraded":"2024-05-12T22:54:46.383776+0000","last_fullsized":"2024-05-12T22:54:46.383776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136855+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:56:51.136855+0000","last_peered":"2024-05-12T22:56:51.136855+0000","last_clean":"2024-05-12T22:56:51.136855+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:56:51.136855+0000","last_undegraded":"2024-05-12T22:56:51.136855+0000","last_fullsized":"2024-05-12T22:56:51.136855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383820+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:54:46.383820+0000","last_peered":"2024-05-12T22:54:46.383820+0000","last_clean":"2024-05-12T22:54:46.383820+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:54:46.383820+0000","last_undegraded":"2024-05-12T22:54:46.383820+0000","last_fullsized":"2024-05-12T22:54:46.383820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136287+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:56:51.136287+0000","last_peered":"2024-05-12T22:56:51.136287+0000","last_clean":"2024-05-12T22:56:51.136287+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:56:51.136287+0000","last_undegraded":"2024-05-12T22:56:51.136287+0000","last_fullsized":"2024-05-12T22:56:51.136287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632252+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:54:23.632252+0000","last_peered":"2024-05-12T22:54:23.632252+0000","last_clean":"2024-05-12T22:54:23.632252+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:54:23.632252+0000","last_undegraded":"2024-05-12T22:54:23.632252+0000","last_fullsized":"2024-05-12T22:54:23.632252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176624+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:56:51.176624+0000","last_peered":"2024-05-12T22:56:51.176624+0000","last_clean":"2024-05-12T22:56:51.176624+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:56:51.176624+0000","last_undegraded":"2024-05-12T22:56:51.176624+0000","last_fullsized":"2024-05-12T22:56:51.176624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'14","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186756+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:56:51.186756+0000","last_peered":"2024-05-12T22:56:51.186756+0000","last_clean":"2024-05-12T22:56:51.186756+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:56:51.186756+0000","last_undegraded":"2024-05-12T22:56:51.186756+0000","last_fullsized":"2024-05-12T22:56:51.186756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:55:07.401253+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:55:07.401253+0000","last_peered":"2024-05-12T22:55:07.401253+0000","last_clean":"2024-05-12T22:55:07.401253+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:55:07.401253+0000","last_undegraded":"2024-05-12T22:55:07.401253+0000","last_fullsized":"2024-05-12T22:55:07.401253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146145+0000","last_change":"2024-05-12T22:53:16.700551+0000","last_active":"2024-05-12T22:56:51.146145+0000","last_peered":"2024-05-12T22:56:51.146145+0000","last_clean":"2024-05-12T22:56:51.146145+0000","last_became_active":"2024-05-12T22:53:16.699663+0000","last_became_peered":"2024-05-12T22:53:16.699663+0000","last_unstale":"2024-05-12T22:56:51.146145+0000","last_undegraded":"2024-05-12T22:56:51.146145+0000","last_fullsized":"2024-05-12T22:56:51.146145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:07:49.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.634053+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:54:20.634053+0000","last_peered":"2024-05-12T22:54:20.634053+0000","last_clean":"2024-05-12T22:54:20.634053+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:54:20.634053+0000","last_undegraded":"2024-05-12T22:54:20.634053+0000","last_fullsized":"2024-05-12T22:54:20.634053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147074+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:56:51.147074+0000","last_peered":"2024-05-12T22:56:51.147074+0000","last_clean":"2024-05-12T22:56:51.147074+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:56:51.147074+0000","last_undegraded":"2024-05-12T22:56:51.147074+0000","last_fullsized":"2024-05-12T22:56:51.147074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:36.393165+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:54:36.393165+0000","last_peered":"2024-05-12T22:54:36.393165+0000","last_clean":"2024-05-12T22:54:36.393165+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:54:36.393165+0000","last_undegraded":"2024-05-12T22:54:36.393165+0000","last_fullsized":"2024-05-12T22:54:36.393165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178191+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:56:51.178191+0000","last_peered":"2024-05-12T22:56:51.178191+0000","last_clean":"2024-05-12T22:56:51.178191+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:56:51.178191+0000","last_undegraded":"2024-05-12T22:56:51.178191+0000","last_fullsized":"2024-05-12T22:56:51.178191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.406554+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:54:41.406554+0000","last_peered":"2024-05-12T22:54:41.406554+0000","last_clean":"2024-05-12T22:54:41.406554+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:54:41.406554+0000","last_undegraded":"2024-05-12T22:54:41.406554+0000","last_fullsized":"2024-05-12T22:54:41.406554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":799303,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":179,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":1598606,"data_compressed":229594,"data_compressed_allocated":278528,"data_compressed_original":1400832,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":675733,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":872380,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":84873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":883288,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":95691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":675789,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":798505,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":787597,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:56:58.223 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-12T22:56:58.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:56:58.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 Processor -- start 2024-05-12T22:56:58.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 -- start start 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66180b5d70 0x7f6618148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f6618148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66180b6150 con 0x7f661813f050 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f661806f990 con 0x7f66180b5d70 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661cfd9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f66180708b0 con 0x7f66180b2c50 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66180b5d70 0x7f6618148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f6616d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f661813f050 0x7f661813f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57444/0 (socket says 172.21.15.40:57444) 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f6616d9d640 1 -- 172.21.15.40:0/4057883757 learned_addr learned my addr 172.21.15.40:0/4057883757 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f6615d9b640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f6618148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 -- 172.21.15.40:0/4057883757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 msgr2=0x7f6618148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f6618148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 -- 172.21.15.40:0/4057883757 >> v1:172.21.15.40:6789/0 conn(0x7f661813f050 legacy=0x7f661813f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 -- 172.21.15.40:0/4057883757 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661806f620 con 0x7f66180b5d70 2024-05-12T22:56:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661559a640 1 -- 172.21.15.40:0/4057883757 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442893582 0 0) 0x7f66180b6150 con 0x7f661813f050 2024-05-12T22:56:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f6615d9b640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f6618148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:56:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.380+0000 7f661659c640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66180b5d70 0x7f6618148960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66080097f0 tx=0x7f660801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deba8d19d845e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661559a640 1 -- 172.21.15.40:0/4057883757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080ab430 con 0x7f66180b5d70 2024-05-12T22:56:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661559a640 1 -- 172.21.15.40:0/4057883757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66080b0070 con 0x7f66180b5d70 2024-05-12T22:56:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661559a640 1 -- 172.21.15.40:0/4057883757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080ab7f0 con 0x7f66180b5d70 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- 172.21.15.40:0/4057883757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66180b5d70 msgr2=0x7f6618148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66180b5d70 0x7f6618148960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66080097f0 tx=0x7f660801c410 comp rx=0 tx=0).stop 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- 172.21.15.40:0/4057883757 shutdown_connections 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f6618148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- 172.21.15.40:0/4057883757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66180b5d70 0x7f6618148960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- 172.21.15.40:0/4057883757 >> 172.21.15.40:0/4057883757 conn(0x7f661806b6c0 msgr2=0x7f661806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- 172.21.15.40:0/4057883757 shutdown_connections 2024-05-12T22:56:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- 172.21.15.40:0/4057883757 wait complete. 2024-05-12T22:56:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 Processor -- start 2024-05-12T22:56:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- start start 2024-05-12T22:56:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f66181423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66180b5d70 0x7f66181428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66181526f0 con 0x7f661813f050 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6618152570 con 0x7f66180b5d70 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661cfd9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f6618152870 con 0x7f66180b2c50 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60476/0 (socket says 172.21.15.40:60476) 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 -- 172.21.15.40:0/2944545738 learned_addr learned my addr 172.21.15.40:0/2944545738 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f661659c640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f66181423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 -- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 msgr2=0x7f66181423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f66181423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 -- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66180b5d70 msgr2=0x7f66181428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66180b5d70 0x7f66181428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 -- 172.21.15.40:0/2944545738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6618141950 con 0x7f661813f050 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.384+0000 7f6616d9d640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f661000c780 tx=0x7f661000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610018070 con 0x7f661813f050 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661000a640 con 0x7f661813f050 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661000aa30 con 0x7f661813f050 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6618145d30 con 0x7f661813f050 2024-05-12T22:56:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6618145a00 con 0x7f661813f050 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6618068330 con 0x7f661813f050 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f661000abd0 con 0x7f661813f050 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 0x7f65f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f66100851b0 con 0x7f661813f050 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f661659c640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 0x7f65f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.388+0000 7f661659c640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 0x7f65f8069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f66080af000 tx=0x7f66080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.392+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6610055d00 con 0x7f661813f050 2024-05-12T22:56:58.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.552+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f661813fda0 con 0x7f65f80678f0 2024-05-12T22:56:58.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.560+0000 7f6606ffd640 1 -- 172.21.15.40:0/2944545738 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252208 (secure 0 0 0) 0x7f66080b0050 con 0x7f65f80678f0 2024-05-12T22:56:58.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:56:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 msgr2=0x7f65f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 0x7f65f8069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f66080af000 tx=0x7f66080a7000 comp rx=0 tx=0).stop 2024-05-12T22:56:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 msgr2=0x7f6618136130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f661000c780 tx=0x7f661000cc40 comp rx=0 tx=0).stop 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 shutdown_connections 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f661813f050 0x7f6618136130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f65f80678f0 0x7f65f8069db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66180b5d70 0x7f66181428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 --2- 172.21.15.40:0/2944545738 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f66180b2c50 0x7f66181423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 >> 172.21.15.40:0/2944545738 conn(0x7f661806b6c0 msgr2=0x7f66181465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 shutdown_connections 2024-05-12T22:56:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.564+0000 7f661cfd9640 1 -- 172.21.15.40:0/2944545738 wait complete. 2024-05-12T22:56:58.586 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-05-12T22:56:57.426980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389671,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":344,"num_write_kb":3287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":871,"ondisk_log_size":871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239408,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754735312,"statfs":{"total":773094113280,"available":772848959488,"internally_reserved":0,"allocated":2539520,"data_stored":3457606,"data_compressed":296616,"data_compressed_allocated":368640,"data_compressed_original":2547712,"omap_allocated":12747,"internal_metadata":242535989},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31297,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":29,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003805"},"pg_stats":[{"pgid":"3.3f","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.177666+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:56:51.177666+0000","last_peered":"2024-05-12T22:56:51.177666+0000","last_clean":"2024-05-12T22:56:51.177666+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:56:51.177666+0000","last_undegraded":"2024-05-12T22:56:51.177666+0000","last_fullsized":"2024-05-12T22:56:51.177666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137815+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:56:51.137815+0000","last_peered":"2024-05-12T22:56:51.137815+0000","last_clean":"2024-05-12T22:56:51.137815+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:56:51.137815+0000","last_undegraded":"2024-05-12T22:56:51.137815+0000","last_fullsized":"2024-05-12T22:56:51.137815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133288+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:56:51.133288+0000","last_peered":"2024-05-12T22:56:51.133288+0000","last_clean":"2024-05-12T22:56:51.133288+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:56:51.133288+0000","last_undegraded":"2024-05-12T22:56:51.133288+0000","last_fullsized":"2024-05-12T22:56:51.133288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:19:34.619204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183765+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:56:51.183765+0000","last_peered":"2024-05-12T22:56:51.183765+0000","last_clean":"2024-05-12T22:56:51.183765+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:56:51.183765+0000","last_undegraded":"2024-05-12T22:56:51.183765+0000","last_fullsized":"2024-05-12T22:56:51.183765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186544+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:56:51.186544+0000","last_peered":"2024-05-12T22:56:51.186544+0000","last_clean":"2024-05-12T22:56:51.186544+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:56:51.186544+0000","last_undegraded":"2024-05-12T22:56:51.186544+0000","last_fullsized":"2024-05-12T22:56:51.186544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182874+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:56:51.182874+0000","last_peered":"2024-05-12T22:56:51.182874+0000","last_clean":"2024-05-12T22:56:51.182874+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:56:51.182874+0000","last_undegraded":"2024-05-12T22:56:51.182874+0000","last_fullsized":"2024-05-12T22:56:51.182874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.166324+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:56:51.166324+0000","last_peered":"2024-05-12T22:56:51.166324+0000","last_clean":"2024-05-12T22:56:51.166324+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:56:51.166324+0000","last_undegraded":"2024-05-12T22:56:51.166324+0000","last_fullsized":"2024-05-12T22:56:51.166324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178881+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:56:51.178881+0000","last_peered":"2024-05-12T22:56:51.178881+0000","last_clean":"2024-05-12T22:56:51.178881+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:56:51.178881+0000","last_undegraded":"2024-05-12T22:56:51.178881+0000","last_fullsized":"2024-05-12T22:56:51.178881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.180668+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:56:51.180668+0000","last_peered":"2024-05-12T22:56:51.180668+0000","last_clean":"2024-05-12T22:56:51.180668+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:56:51.180668+0000","last_undegraded":"2024-05-12T22:56:51.180668+0000","last_fullsized":"2024-05-12T22:56:51.180668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'16","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188935+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:56:51.188935+0000","last_peered":"2024-05-12T22:56:51.188935+0000","last_clean":"2024-05-12T22:56:51.188935+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:56:51.188935+0000","last_undegraded":"2024-05-12T22:56:51.188935+0000","last_fullsized":"2024-05-12T22:56:51.188935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182310+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:56:51.182310+0000","last_peered":"2024-05-12T22:56:51.182310+0000","last_clean":"2024-05-12T22:56:51.182310+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:56:51.182310+0000","last_undegraded":"2024-05-12T22:56:51.182310+0000","last_fullsized":"2024-05-12T22:56:51.182310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179011+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:56:51.179011+0000","last_peered":"2024-05-12T22:56:51.179011+0000","last_clean":"2024-05-12T22:56:51.179011+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:56:51.179011+0000","last_undegraded":"2024-05-12T22:56:51.179011+0000","last_fullsized":"2024-05-12T22:56:51.179011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:05.541680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173134+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:56:51.173134+0000","last_peered":"2024-05-12T22:56:51.173134+0000","last_clean":"2024-05-12T22:56:51.173134+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:56:51.173134+0000","last_undegraded":"2024-05-12T22:56:51.173134+0000","last_fullsized":"2024-05-12T22:56:51.173134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.120262+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:56:51.120262+0000","last_peered":"2024-05-12T22:56:51.120262+0000","last_clean":"2024-05-12T22:56:51.120262+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:56:51.120262+0000","last_undegraded":"2024-05-12T22:56:51.120262+0000","last_fullsized":"2024-05-12T22:56:51.120262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:28:19.774156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.171392+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:56:51.171392+0000","last_peered":"2024-05-12T22:56:51.171392+0000","last_clean":"2024-05-12T22:56:51.171392+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:56:51.171392+0000","last_undegraded":"2024-05-12T22:56:51.171392+0000","last_fullsized":"2024-05-12T22:56:51.171392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'11","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.128437+0000","last_change":"2024-05-12T22:53:16.797441+0000","last_active":"2024-05-12T22:56:51.128437+0000","last_peered":"2024-05-12T22:56:51.128437+0000","last_clean":"2024-05-12T22:56:51.128437+0000","last_became_active":"2024-05-12T22:53:16.796573+0000","last_became_peered":"2024-05-12T22:53:16.796573+0000","last_unstale":"2024-05-12T22:56:51.128437+0000","last_undegraded":"2024-05-12T22:56:51.128437+0000","last_fullsized":"2024-05-12T22:56:51.128437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:00:31.347895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179157+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:56:51.179157+0000","last_peered":"2024-05-12T22:56:51.179157+0000","last_clean":"2024-05-12T22:56:51.179157+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:56:51.179157+0000","last_undegraded":"2024-05-12T22:56:51.179157+0000","last_fullsized":"2024-05-12T22:56:51.179157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172422+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:56:51.172422+0000","last_peered":"2024-05-12T22:56:51.172422+0000","last_clean":"2024-05-12T22:56:51.172422+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:56:51.172422+0000","last_undegraded":"2024-05-12T22:56:51.172422+0000","last_fullsized":"2024-05-12T22:56:51.172422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:05:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.168264+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:56:51.168264+0000","last_peered":"2024-05-12T22:56:51.168264+0000","last_clean":"2024-05-12T22:56:51.168264+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:56:51.168264+0000","last_undegraded":"2024-05-12T22:56:51.168264+0000","last_fullsized":"2024-05-12T22:56:51.168264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184335+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:56:51.184335+0000","last_peered":"2024-05-12T22:56:51.184335+0000","last_clean":"2024-05-12T22:56:51.184335+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:56:51.184335+0000","last_undegraded":"2024-05-12T22:56:51.184335+0000","last_fullsized":"2024-05-12T22:56:51.184335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.189517+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:56:51.189517+0000","last_peered":"2024-05-12T22:56:51.189517+0000","last_clean":"2024-05-12T22:56:51.189517+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:56:51.189517+0000","last_undegraded":"2024-05-12T22:56:51.189517+0000","last_fullsized":"2024-05-12T22:56:51.189517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:22:41.503407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186658+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:56:51.186658+0000","last_peered":"2024-05-12T22:56:51.186658+0000","last_clean":"2024-05-12T22:56:51.186658+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:56:51.186658+0000","last_undegraded":"2024-05-12T22:56:51.186658+0000","last_fullsized":"2024-05-12T22:56:51.186658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146422+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:56:51.146422+0000","last_peered":"2024-05-12T22:56:51.146422+0000","last_clean":"2024-05-12T22:56:51.146422+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:56:51.146422+0000","last_undegraded":"2024-05-12T22:56:51.146422+0000","last_fullsized":"2024-05-12T22:56:51.146422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181469+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:56:51.181469+0000","last_peered":"2024-05-12T22:56:51.181469+0000","last_clean":"2024-05-12T22:56:51.181469+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:56:51.181469+0000","last_undegraded":"2024-05-12T22:56:51.181469+0000","last_fullsized":"2024-05-12T22:56:51.181469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.151233+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:56:51.151233+0000","last_peered":"2024-05-12T22:56:51.151233+0000","last_clean":"2024-05-12T22:56:51.151233+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:56:51.151233+0000","last_undegraded":"2024-05-12T22:56:51.151233+0000","last_fullsized":"2024-05-12T22:56:51.151233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188917+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:56:51.188917+0000","last_peered":"2024-05-12T22:56:51.188917+0000","last_clean":"2024-05-12T22:56:51.188917+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:56:51.188917+0000","last_undegraded":"2024-05-12T22:56:51.188917+0000","last_fullsized":"2024-05-12T22:56:51.188917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133086+0000","last_change":"2024-05-12T22:53:16.705033+0000","last_active":"2024-05-12T22:56:51.133086+0000","last_peered":"2024-05-12T22:56:51.133086+0000","last_clean":"2024-05-12T22:56:51.133086+0000","last_became_active":"2024-05-12T22:53:16.704085+0000","last_became_peered":"2024-05-12T22:53:16.704085+0000","last_unstale":"2024-05-12T22:56:51.133086+0000","last_undegraded":"2024-05-12T22:56:51.133086+0000","last_fullsized":"2024-05-12T22:56:51.133086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:11:57.355073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.175677+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:56:51.175677+0000","last_peered":"2024-05-12T22:56:51.175677+0000","last_clean":"2024-05-12T22:56:51.175677+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:56:51.175677+0000","last_undegraded":"2024-05-12T22:56:51.175677+0000","last_fullsized":"2024-05-12T22:56:51.175677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.131434+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:56:51.131434+0000","last_peered":"2024-05-12T22:56:51.131434+0000","last_clean":"2024-05-12T22:56:51.131434+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:56:51.131434+0000","last_undegraded":"2024-05-12T22:56:51.131434+0000","last_fullsized":"2024-05-12T22:56:51.131434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:42:15.286476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183211+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:56:51.183211+0000","last_peered":"2024-05-12T22:56:51.183211+0000","last_clean":"2024-05-12T22:56:51.183211+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:56:51.183211+0000","last_undegraded":"2024-05-12T22:56:51.183211+0000","last_fullsized":"2024-05-12T22:56:51.183211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.130751+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:56:51.130751+0000","last_peered":"2024-05-12T22:56:51.130751+0000","last_clean":"2024-05-12T22:56:51.130751+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:56:51.130751+0000","last_undegraded":"2024-05-12T22:56:51.130751+0000","last_fullsized":"2024-05-12T22:56:51.130751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:25.439049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.162196+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:56:51.162196+0000","last_peered":"2024-05-12T22:56:51.162196+0000","last_clean":"2024-05-12T22:56:51.162196+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:56:51.162196+0000","last_undegraded":"2024-05-12T22:56:51.162196+0000","last_fullsized":"2024-05-12T22:56:51.162196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146258+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:56:51.146258+0000","last_peered":"2024-05-12T22:56:51.146258+0000","last_clean":"2024-05-12T22:56:51.146258+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:56:51.146258+0000","last_undegraded":"2024-05-12T22:56:51.146258+0000","last_fullsized":"2024-05-12T22:56:51.146258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:40.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.628217+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:54:20.628217+0000","last_peered":"2024-05-12T22:54:20.628217+0000","last_clean":"2024-05-12T22:54:20.628217+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:54:20.628217+0000","last_undegraded":"2024-05-12T22:54:20.628217+0000","last_fullsized":"2024-05-12T22:54:20.628217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.142227+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:56:51.142227+0000","last_peered":"2024-05-12T22:56:51.142227+0000","last_clean":"2024-05-12T22:56:51.142227+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:56:51.142227+0000","last_undegraded":"2024-05-12T22:56:51.142227+0000","last_fullsized":"2024-05-12T22:56:51.142227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.632005+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:54:20.632005+0000","last_peered":"2024-05-12T22:54:20.632005+0000","last_clean":"2024-05-12T22:54:20.632005+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:54:20.632005+0000","last_undegraded":"2024-05-12T22:54:20.632005+0000","last_fullsized":"2024-05-12T22:54:20.632005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.636641+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:54:23.636641+0000","last_peered":"2024-05-12T22:54:23.636641+0000","last_clean":"2024-05-12T22:54:23.636641+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:54:23.636641+0000","last_undegraded":"2024-05-12T22:54:23.636641+0000","last_fullsized":"2024-05-12T22:54:23.636641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134633+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:56:51.134633+0000","last_peered":"2024-05-12T22:56:51.134633+0000","last_clean":"2024-05-12T22:56:51.134633+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:56:51.134633+0000","last_undegraded":"2024-05-12T22:56:51.134633+0000","last_fullsized":"2024-05-12T22:56:51.134633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.633590+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:54:23.633590+0000","last_peered":"2024-05-12T22:54:23.633590+0000","last_clean":"2024-05-12T22:54:23.633590+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:54:23.633590+0000","last_undegraded":"2024-05-12T22:54:23.633590+0000","last_fullsized":"2024-05-12T22:54:23.633590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'11","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137927+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:56:51.137927+0000","last_peered":"2024-05-12T22:56:51.137927+0000","last_clean":"2024-05-12T22:56:51.137927+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:56:51.137927+0000","last_undegraded":"2024-05-12T22:56:51.137927+0000","last_fullsized":"2024-05-12T22:56:51.137927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.631837+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:54:23.631837+0000","last_peered":"2024-05-12T22:54:23.631837+0000","last_clean":"2024-05-12T22:54:23.631837+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:54:23.631837+0000","last_undegraded":"2024-05-12T22:54:23.631837+0000","last_fullsized":"2024-05-12T22:54:23.631837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169465+0000","last_change":"2024-05-12T22:53:16.797487+0000","last_active":"2024-05-12T22:56:51.169465+0000","last_peered":"2024-05-12T22:56:51.169465+0000","last_clean":"2024-05-12T22:56:51.169465+0000","last_became_active":"2024-05-12T22:53:16.796547+0000","last_became_peered":"2024-05-12T22:53:16.796547+0000","last_unstale":"2024-05-12T22:56:51.169465+0000","last_undegraded":"2024-05-12T22:56:51.169465+0000","last_fullsized":"2024-05-12T22:56:51.169465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:06:32.862154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.634995+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:54:23.634995+0000","last_peered":"2024-05-12T22:54:23.634995+0000","last_clean":"2024-05-12T22:54:23.634995+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:54:23.634995+0000","last_undegraded":"2024-05-12T22:54:23.634995+0000","last_fullsized":"2024-05-12T22:54:23.634995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147092+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:56:51.147092+0000","last_peered":"2024-05-12T22:56:51.147092+0000","last_clean":"2024-05-12T22:56:51.147092+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:56:51.147092+0000","last_undegraded":"2024-05-12T22:56:51.147092+0000","last_fullsized":"2024-05-12T22:56:51.147092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'15","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:48.746525+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:56:48.746525+0000","last_peered":"2024-05-12T22:56:48.746525+0000","last_clean":"2024-05-12T22:56:48.746525+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:56:48.746525+0000","last_undegraded":"2024-05-12T22:56:48.746525+0000","last_fullsized":"2024-05-12T22:56:48.746525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:20:03.931396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188577+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:56:51.188577+0000","last_peered":"2024-05-12T22:56:51.188577+0000","last_clean":"2024-05-12T22:56:51.188577+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:56:51.188577+0000","last_undegraded":"2024-05-12T22:56:51.188577+0000","last_fullsized":"2024-05-12T22:56:51.188577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:28.642249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'50","reported_seq":68,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.192438+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:56:51.192438+0000","last_peered":"2024-05-12T22:56:51.192438+0000","last_clean":"2024-05-12T22:56:51.192438+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:56:51.192438+0000","last_undegraded":"2024-05-12T22:56:51.192438+0000","last_fullsized":"2024-05-12T22:56:51.192438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":787597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.164394+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:56:51.164394+0000","last_peered":"2024-05-12T22:56:51.164394+0000","last_clean":"2024-05-12T22:56:51.164394+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:56:51.164394+0000","last_undegraded":"2024-05-12T22:56:51.164394+0000","last_fullsized":"2024-05-12T22:56:51.164394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:15.613646+0000","last_change":"2024-05-12T22:52:34.567816+0000","last_active":"2024-05-12T22:54:15.613646+0000","last_peered":"2024-05-12T22:54:15.613646+0000","last_clean":"2024-05-12T22:54:15.613646+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:54:15.613646+0000","last_undegraded":"2024-05-12T22:54:15.613646+0000","last_fullsized":"2024-05-12T22:54:15.613646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:44:16.419716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169103+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:56:51.169103+0000","last_peered":"2024-05-12T22:56:51.169103+0000","last_clean":"2024-05-12T22:56:51.169103+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:56:51.169103+0000","last_undegraded":"2024-05-12T22:56:51.169103+0000","last_fullsized":"2024-05-12T22:56:51.169103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:28.956539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:24.626650+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:54:24.626650+0000","last_peered":"2024-05-12T22:54:24.626650+0000","last_clean":"2024-05-12T22:54:24.626650+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:54:24.626650+0000","last_undegraded":"2024-05-12T22:54:24.626650+0000","last_fullsized":"2024-05-12T22:54:24.626650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'20","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186680+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:56:51.186680+0000","last_peered":"2024-05-12T22:56:51.186680+0000","last_clean":"2024-05-12T22:56:51.186680+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:56:51.186680+0000","last_undegraded":"2024-05-12T22:56:51.186680+0000","last_fullsized":"2024-05-12T22:56:51.186680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632570+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:54:23.632570+0000","last_peered":"2024-05-12T22:54:23.632570+0000","last_clean":"2024-05-12T22:54:23.632570+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:54:23.632570+0000","last_undegraded":"2024-05-12T22:54:23.632570+0000","last_fullsized":"2024-05-12T22:54:23.632570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173281+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:56:51.173281+0000","last_peered":"2024-05-12T22:56:51.173281+0000","last_clean":"2024-05-12T22:56:51.173281+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:56:51.173281+0000","last_undegraded":"2024-05-12T22:56:51.173281+0000","last_fullsized":"2024-05-12T22:56:51.173281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:56.396852+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:54:56.396852+0000","last_peered":"2024-05-12T22:54:56.396852+0000","last_clean":"2024-05-12T22:54:56.396852+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:54:56.396852+0000","last_undegraded":"2024-05-12T22:54:56.396852+0000","last_fullsized":"2024-05-12T22:54:56.396852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176530+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:56:51.176530+0000","last_peered":"2024-05-12T22:56:51.176530+0000","last_clean":"2024-05-12T22:56:51.176530+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:56:51.176530+0000","last_undegraded":"2024-05-12T22:56:51.176530+0000","last_fullsized":"2024-05-12T22:56:51.176530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632749+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:54:23.632749+0000","last_peered":"2024-05-12T22:54:23.632749+0000","last_clean":"2024-05-12T22:54:23.632749+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:54:23.632749+0000","last_undegraded":"2024-05-12T22:54:23.632749+0000","last_fullsized":"2024-05-12T22:54:23.632749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176193+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:56:51.176193+0000","last_peered":"2024-05-12T22:56:51.176193+0000","last_clean":"2024-05-12T22:56:51.176193+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:56:51.176193+0000","last_undegraded":"2024-05-12T22:56:51.176193+0000","last_fullsized":"2024-05-12T22:56:51.176193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632760+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:54:23.632760+0000","last_peered":"2024-05-12T22:54:23.632760+0000","last_clean":"2024-05-12T22:54:23.632760+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:54:23.632760+0000","last_undegraded":"2024-05-12T22:54:23.632760+0000","last_fullsized":"2024-05-12T22:54:23.632760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184494+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:56:51.184494+0000","last_peered":"2024-05-12T22:56:51.184494+0000","last_clean":"2024-05-12T22:56:51.184494+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:56:51.184494+0000","last_undegraded":"2024-05-12T22:56:51.184494+0000","last_fullsized":"2024-05-12T22:56:51.184494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.635135+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:54:23.635135+0000","last_peered":"2024-05-12T22:54:23.635135+0000","last_clean":"2024-05-12T22:54:23.635135+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:54:23.635135+0000","last_undegraded":"2024-05-12T22:54:23.635135+0000","last_fullsized":"2024-05-12T22:54:23.635135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:07:38.585153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183640+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:56:51.183640+0000","last_peered":"2024-05-12T22:56:51.183640+0000","last_clean":"2024-05-12T22:56:51.183640+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:56:51.183640+0000","last_undegraded":"2024-05-12T22:56:51.183640+0000","last_fullsized":"2024-05-12T22:56:51.183640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:51.396109+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:54:51.396109+0000","last_peered":"2024-05-12T22:54:51.396109+0000","last_clean":"2024-05-12T22:54:51.396109+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:54:51.396109+0000","last_undegraded":"2024-05-12T22:54:51.396109+0000","last_fullsized":"2024-05-12T22:54:51.396109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:14:09.847443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183083+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:56:51.183083+0000","last_peered":"2024-05-12T22:56:51.183083+0000","last_clean":"2024-05-12T22:56:51.183083+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:56:51.183083+0000","last_undegraded":"2024-05-12T22:56:51.183083+0000","last_fullsized":"2024-05-12T22:56:51.183083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:22.393910+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:54:22.393910+0000","last_peered":"2024-05-12T22:54:22.393910+0000","last_clean":"2024-05-12T22:54:22.393910+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:54:22.393910+0000","last_undegraded":"2024-05-12T22:54:22.393910+0000","last_fullsized":"2024-05-12T22:54:22.393910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394617+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:54:42.394617+0000","last_peered":"2024-05-12T22:54:42.394617+0000","last_clean":"2024-05-12T22:54:42.394617+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:54:42.394617+0000","last_undegraded":"2024-05-12T22:54:42.394617+0000","last_fullsized":"2024-05-12T22:54:42.394617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178597+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:56:51.178597+0000","last_peered":"2024-05-12T22:56:51.178597+0000","last_clean":"2024-05-12T22:56:51.178597+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:56:51.178597+0000","last_undegraded":"2024-05-12T22:56:51.178597+0000","last_fullsized":"2024-05-12T22:56:51.178597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:37.396332+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:54:37.396332+0000","last_peered":"2024-05-12T22:54:37.396332+0000","last_clean":"2024-05-12T22:54:37.396332+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:54:37.396332+0000","last_undegraded":"2024-05-12T22:54:37.396332+0000","last_fullsized":"2024-05-12T22:54:37.396332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.117301+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:56:51.117301+0000","last_peered":"2024-05-12T22:56:51.117301+0000","last_clean":"2024-05-12T22:56:51.117301+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:56:51.117301+0000","last_undegraded":"2024-05-12T22:56:51.117301+0000","last_fullsized":"2024-05-12T22:56:51.117301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:53.921987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'20","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.736349+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:56:50.736349+0000","last_peered":"2024-05-12T22:56:50.736349+0000","last_clean":"2024-05-12T22:56:50.736349+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:56:50.736349+0000","last_undegraded":"2024-05-12T22:56:50.736349+0000","last_fullsized":"2024-05-12T22:56:50.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:44:15.315632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10908,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":14,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134952+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:56:51.134952+0000","last_peered":"2024-05-12T22:56:51.134952+0000","last_clean":"2024-05-12T22:56:51.134952+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:56:51.134952+0000","last_undegraded":"2024-05-12T22:56:51.134952+0000","last_fullsized":"2024-05-12T22:56:51.134952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:38:59.226670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394592+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:54:42.394592+0000","last_peered":"2024-05-12T22:54:42.394592+0000","last_clean":"2024-05-12T22:54:42.394592+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:54:42.394592+0000","last_undegraded":"2024-05-12T22:54:42.394592+0000","last_fullsized":"2024-05-12T22:54:42.394592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.145734+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:56:51.145734+0000","last_peered":"2024-05-12T22:56:51.145734+0000","last_clean":"2024-05-12T22:56:51.145734+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:56:51.145734+0000","last_undegraded":"2024-05-12T22:56:51.145734+0000","last_fullsized":"2024-05-12T22:56:51.145734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:05.221936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.383001+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:54:41.383001+0000","last_peered":"2024-05-12T22:54:41.383001+0000","last_clean":"2024-05-12T22:54:41.383001+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:54:41.383001+0000","last_undegraded":"2024-05-12T22:54:41.383001+0000","last_fullsized":"2024-05-12T22:54:41.383001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:29:12.603266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181791+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:56:51.181791+0000","last_peered":"2024-05-12T22:56:51.181791+0000","last_clean":"2024-05-12T22:56:51.181791+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:56:51.181791+0000","last_undegraded":"2024-05-12T22:56:51.181791+0000","last_fullsized":"2024-05-12T22:56:51.181791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.397237+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:54:42.397237+0000","last_peered":"2024-05-12T22:54:42.397237+0000","last_clean":"2024-05-12T22:54:42.397237+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:54:42.397237+0000","last_undegraded":"2024-05-12T22:54:42.397237+0000","last_fullsized":"2024-05-12T22:54:42.397237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133019+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:56:51.133019+0000","last_peered":"2024-05-12T22:56:51.133019+0000","last_clean":"2024-05-12T22:56:51.133019+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:56:51.133019+0000","last_undegraded":"2024-05-12T22:56:51.133019+0000","last_fullsized":"2024-05-12T22:56:51.133019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:23:03.572376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'42","reported_seq":62,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.569927+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:56:50.569927+0000","last_peered":"2024-05-12T22:56:50.569927+0000","last_clean":"2024-05-12T22:56:50.569927+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:56:50.569927+0000","last_undegraded":"2024-05-12T22:56:50.569927+0000","last_fullsized":"2024-05-12T22:56:50.569927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:17:46.864747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172431+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:56:51.172431+0000","last_peered":"2024-05-12T22:56:51.172431+0000","last_clean":"2024-05-12T22:56:51.172431+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:56:51.172431+0000","last_undegraded":"2024-05-12T22:56:51.172431+0000","last_fullsized":"2024-05-12T22:56:51.172431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.401513+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:54:47.401513+0000","last_peered":"2024-05-12T22:54:47.401513+0000","last_clean":"2024-05-12T22:54:47.401513+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:54:47.401513+0000","last_undegraded":"2024-05-12T22:54:47.401513+0000","last_fullsized":"2024-05-12T22:54:47.401513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136232+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:56:51.136232+0000","last_peered":"2024-05-12T22:56:51.136232+0000","last_clean":"2024-05-12T22:56:51.136232+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:56:51.136232+0000","last_undegraded":"2024-05-12T22:56:51.136232+0000","last_fullsized":"2024-05-12T22:56:51.136232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:24.536579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.398007+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:54:47.398007+0000","last_peered":"2024-05-12T22:54:47.398007+0000","last_clean":"2024-05-12T22:54:47.398007+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:54:47.398007+0000","last_undegraded":"2024-05-12T22:54:47.398007+0000","last_fullsized":"2024-05-12T22:54:47.398007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.149749+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:56:51.149749+0000","last_peered":"2024-05-12T22:56:51.149749+0000","last_clean":"2024-05-12T22:56:51.149749+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:56:51.149749+0000","last_undegraded":"2024-05-12T22:56:51.149749+0000","last_fullsized":"2024-05-12T22:56:51.149749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:40.195573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383776+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:54:46.383776+0000","last_peered":"2024-05-12T22:54:46.383776+0000","last_clean":"2024-05-12T22:54:46.383776+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:54:46.383776+0000","last_undegraded":"2024-05-12T22:54:46.383776+0000","last_fullsized":"2024-05-12T22:54:46.383776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:47:13.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136855+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:56:51.136855+0000","last_peered":"2024-05-12T22:56:51.136855+0000","last_clean":"2024-05-12T22:56:51.136855+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:56:51.136855+0000","last_undegraded":"2024-05-12T22:56:51.136855+0000","last_fullsized":"2024-05-12T22:56:51.136855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:46.383820+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:54:46.383820+0000","last_peered":"2024-05-12T22:54:46.383820+0000","last_clean":"2024-05-12T22:54:46.383820+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:54:46.383820+0000","last_undegraded":"2024-05-12T22:54:46.383820+0000","last_fullsized":"2024-05-12T22:54:46.383820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:14.558750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136287+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:56:51.136287+0000","last_peered":"2024-05-12T22:56:51.136287+0000","last_clean":"2024-05-12T22:56:51.136287+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:56:51.136287+0000","last_undegraded":"2024-05-12T22:56:51.136287+0000","last_fullsized":"2024-05-12T22:56:51.136287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632252+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:54:23.632252+0000","last_peered":"2024-05-12T22:54:23.632252+0000","last_clean":"2024-05-12T22:54:23.632252+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:54:23.632252+0000","last_undegraded":"2024-05-12T22:54:23.632252+0000","last_fullsized":"2024-05-12T22:54:23.632252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176624+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:56:51.176624+0000","last_peered":"2024-05-12T22:56:51.176624+0000","last_clean":"2024-05-12T22:56:51.176624+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:56:51.176624+0000","last_undegraded":"2024-05-12T22:56:51.176624+0000","last_fullsized":"2024-05-12T22:56:51.176624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'14","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186756+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:56:51.186756+0000","last_peered":"2024-05-12T22:56:51.186756+0000","last_clean":"2024-05-12T22:56:51.186756+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:56:51.186756+0000","last_undegraded":"2024-05-12T22:56:51.186756+0000","last_fullsized":"2024-05-12T22:56:51.186756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:55:07.401253+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:55:07.401253+0000","last_peered":"2024-05-12T22:55:07.401253+0000","last_clean":"2024-05-12T22:55:07.401253+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:55:07.401253+0000","last_undegraded":"2024-05-12T22:55:07.401253+0000","last_fullsized":"2024-05-12T22:55:07.401253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146145+0000","last_change":"2024-05-12T22:53:16.700551+0000","last_active":"2024-05-12T22:56:51.146145+0000","last_peered":"2024-05-12T22:56:51.146145+0000","last_clean":"2024-05-12T22:56:51.146145+0000","last_became_active":"2024-05-12T22:53:16.699663+0000","last_became_peered":"2024-05-12T22:53:16.699663+0000","last_unstale":"2024-05-12T22:56:51.146145+0000","last_undegraded":"2024-05-12T22:56:51.146145+0000","last_fullsized":"2024-05-12T22:56:51.146145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:07:49.839506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.634053+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:54:20.634053+0000","last_peered":"2024-05-12T22:54:20.634053+0000","last_clean":"2024-05-12T22:54:20.634053+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:54:20.634053+0000","last_undegraded":"2024-05-12T22:54:20.634053+0000","last_fullsized":"2024-05-12T22:54:20.634053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147074+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:56:51.147074+0000","last_peered":"2024-05-12T22:56:51.147074+0000","last_clean":"2024-05-12T22:56:51.147074+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:56:51.147074+0000","last_undegraded":"2024-05-12T22:56:51.147074+0000","last_fullsized":"2024-05-12T22:56:51.147074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:59:06.820392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:36.393165+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:54:36.393165+0000","last_peered":"2024-05-12T22:54:36.393165+0000","last_clean":"2024-05-12T22:54:36.393165+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:54:36.393165+0000","last_undegraded":"2024-05-12T22:54:36.393165+0000","last_fullsized":"2024-05-12T22:54:36.393165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178191+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:56:51.178191+0000","last_peered":"2024-05-12T22:56:51.178191+0000","last_clean":"2024-05-12T22:56:51.178191+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:56:51.178191+0000","last_undegraded":"2024-05-12T22:56:51.178191+0000","last_fullsized":"2024-05-12T22:56:51.178191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:41.406554+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:54:41.406554+0000","last_peered":"2024-05-12T22:54:41.406554+0000","last_clean":"2024-05-12T22:54:41.406554+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:54:41.406554+0000","last_undegraded":"2024-05-12T22:54:41.406554+0000","last_fullsized":"2024-05-12T22:54:41.406554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:10:41.686401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":799303,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":179,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":1598606,"data_compressed":229594,"data_compressed_allocated":278528,"data_compressed_original":1400832,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":675733,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":872380,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":84873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":883288,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":95691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":675789,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":798505,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":787597,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:56:58.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:56:58.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.748+0000 7eff4c1a6640 1 Processor -- start 2024-05-12T22:56:58.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.748+0000 7eff4c1a6640 1 -- start start 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff4c1a6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff4413f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff4c1a6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440b6150 con 0x7eff440b5d70 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff4c1a6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4406f620 con 0x7eff440b2c50 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff4c1a6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7eff4406f990 con 0x7eff44149070 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff440b5d70 0x7eff44148960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57450/0 (socket says 172.21.15.40:57450) 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 -- 172.21.15.40:0/3822376870 learned_addr learned my addr 172.21.15.40:0/3822376870 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49741640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff4413f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305682607 0 0) 0x7eff440b6150 con 0x7eff440b5d70 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff30003530 con 0x7eff440b5d70 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4126033969 0 0) 0x7eff30003530 con 0x7eff440b5d70 2024-05-12T22:56:58.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 msgr2=0x7eff4413f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff4413f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 >> v1:172.21.15.47:6789/0 conn(0x7eff440b2c50 legacy=0x7eff4414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440b4ea0 con 0x7eff440b5d70 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7eff40001680 con 0x7eff440b5d70 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 >> v1:172.21.15.40:6789/0 conn(0x7eff440b5d70 legacy=0x7eff44148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff300039f0 0x7eff30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff30005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7eff3000bb60 con 0x7eff300039f0 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff3000bce0 con 0x7eff30004810 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7eff3000beb0 con 0x7eff44149070 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff300039f0 0x7eff30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49741640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 -- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 msgr2=0x7eff30005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff4a743640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff30005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44149070 0x7eff30005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 -- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff30004810 msgr2=0x7eff30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49f42640 1 -- 172.21.15.40:0/3822376870 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff30003530 con 0x7eff300039f0 2024-05-12T22:56:58.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.752+0000 7eff49741640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff30004810 0x7eff30004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49f42640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff300039f0 0x7eff30003e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c270 tx=0x7eff4001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a116ff30553e064d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40007d20 con 0x7eff300039f0 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff400a9070 con 0x7eff300039f0 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff48f40640 1 -- 172.21.15.40:0/3822376870 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff400a5e00 con 0x7eff300039f0 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/3822376870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff300039f0 msgr2=0x7eff30003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/3822376870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff300039f0 0x7eff30003e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c270 tx=0x7eff4001cc80 comp rx=0 tx=0).stop 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4a743640 1 -- 172.21.15.40:0/3822376870 reap_dead start 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/3822376870 shutdown_connections 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/3822376870 >> 172.21.15.40:0/3822376870 conn(0x7eff4406b6c0 msgr2=0x7eff4406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/3822376870 shutdown_connections 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/3822376870 wait complete. 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 Processor -- start 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- start start 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff300039f0 0x7eff441e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44139e60 0x7eff4413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7eff44151c80 con 0x7eff44138970 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff440708b0 con 0x7eff300039f0 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7eff44151e00 con 0x7eff44139e60 2024-05-12T22:56:58.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60496/0 (socket says 172.21.15.40:60496) 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 -- 172.21.15.40:0/1779658630 learned_addr learned my addr 172.21.15.40:0/1779658630 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4a743640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44139e60 0x7eff4413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49f42640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff300039f0 0x7eff441e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 -- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44139e60 msgr2=0x7eff4413a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44139e60 0x7eff4413a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 -- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff300039f0 msgr2=0x7eff441e1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff300039f0 0x7eff441e1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 -- 172.21.15.40:0/1779658630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff44139380 con 0x7eff44138970 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff49741640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff3800f380 tx=0x7eff3800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3801c070 con 0x7eff44138970 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38017600 con 0x7eff44138970 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff44139660 con 0x7eff44138970 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380179f0 con 0x7eff44138970 2024-05-12T22:56:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.756+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff441429c0 con 0x7eff44138970 2024-05-12T22:56:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44068330 con 0x7eff44138970 2024-05-12T22:56:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff3801f070 con 0x7eff44138970 2024-05-12T22:56:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff367fc640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 0x7eff28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:56:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7eff38085ec0 con 0x7eff44138970 2024-05-12T22:56:58.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff49f42640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 0x7eff28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:56:58.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.760+0000 7eff49f42640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 0x7eff28069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff400ab000 tx=0x7eff400b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:56:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.764+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7eff38012070 con 0x7eff44138970 2024-05-12T22:56:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.924+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff44147450 con 0x7eff44138970 2024-05-12T22:56:58.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.924+0000 7eff367fc640 1 -- 172.21.15.40:0/1779658630 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16783 (secure 0 0 0) 0x7eff380563c0 con 0x7eff44138970 2024-05-12T22:56:58.929 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:56:58.929 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:53:16.686879+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:56:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 msgr2=0x7eff28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 0x7eff28069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7eff400ab000 tx=0x7eff400b1040 comp rx=0 tx=0).stop 2024-05-12T22:56:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 msgr2=0x7eff44138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:56:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff3800f380 tx=0x7eff3800f840 comp rx=0 tx=0).stop 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 shutdown_connections 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7eff44139e60 0x7eff4413a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff44138970 0x7eff44138df0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7eff280678c0 0x7eff28069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 --2- 172.21.15.40:0/1779658630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff300039f0 0x7eff441e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 >> 172.21.15.40:0/1779658630 conn(0x7eff4406b6c0 msgr2=0x7eff44145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 shutdown_connections 2024-05-12T22:56:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:56:58.928+0000 7eff4c1a6640 1 -- 172.21.15.40:0/1779658630 wait complete. 2024-05-12T22:56:59.948 INFO:tasks.ceph:Scrubbing osd.0 2024-05-12T22:56:59.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 Processor -- start 2024-05-12T22:57:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 -- start start 2024-05-12T22:57:00.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9200b59d0 0x7ff920148020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 0x7ff920141290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff920141c60 con 0x7ff9201417d0 2024-05-12T22:57:00.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff920148560 con 0x7ff9200b59d0 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff926e98640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200b5db0 con 0x7ff9200b77b0 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff924c34640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9200b59d0 0x7ff920148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 0x7ff920141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff925435640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff9201417d0 0x7ff92014ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:47090/0 (socket says 172.21.15.40:47090) 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff925435640 1 -- 172.21.15.40:0/1313180649 learned_addr learned my addr 172.21.15.40:0/1313180649 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff924c34640 1 -- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 msgr2=0x7ff920141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff924c34640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 0x7ff920141290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff924c34640 1 -- 172.21.15.40:0/1313180649 >> v1:172.21.15.47:6789/0 conn(0x7ff9201417d0 legacy=0x7ff92014ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff924c34640 1 -- 172.21.15.40:0/1313180649 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff920147560 con 0x7ff9200b59d0 2024-05-12T22:57:00.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.088+0000 7ff91ffff640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 0x7ff920141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-12T22:57:00.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff924c34640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9200b59d0 0x7ff920148020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097c0 tx=0x7ff91001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8f77221f723a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff91f7fe640 1 -- 172.21.15.40:0/1313180649 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100b0070 con 0x7ff9200b59d0 2024-05-12T22:57:00.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff91f7fe640 1 -- 172.21.15.40:0/1313180649 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100ab600 con 0x7ff9200b59d0 2024-05-12T22:57:00.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff91f7fe640 1 -- 172.21.15.40:0/1313180649 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100ab9d0 con 0x7ff9200b59d0 2024-05-12T22:57:00.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9200b59d0 msgr2=0x7ff920148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9200b59d0 0x7ff920148020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097c0 tx=0x7ff91001c380 comp rx=0 tx=0).stop 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- 172.21.15.40:0/1313180649 shutdown_connections 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b77b0 0x7ff920141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 --2- 172.21.15.40:0/1313180649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9200b59d0 0x7ff920148020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- 172.21.15.40:0/1313180649 >> 172.21.15.40:0/1313180649 conn(0x7ff9200bce30 msgr2=0x7ff9200bd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- 172.21.15.40:0/1313180649 shutdown_connections 2024-05-12T22:57:00.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- 172.21.15.40:0/1313180649 wait complete. 2024-05-12T22:57:00.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 Processor -- start 2024-05-12T22:57:00.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.092+0000 7ff926e98640 1 -- start start 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b59d0 0x7ff920149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 0x7ff9201e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9201417d0 0x7ff920151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200b96d0 con 0x7ff9200b77b0 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200b9550 con 0x7ff9201417d0 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200b5080 con 0x7ff9200b59d0 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 0x7ff9201e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 0x7ff9201e3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45198/0 (socket says 172.21.15.40:45198) 2024-05-12T22:57:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 -- 172.21.15.40:0/163787063 learned_addr learned my addr 172.21.15.40:0/163787063 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff924c34640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b59d0 0x7ff920149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff925435640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9201417d0 0x7ff920151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 -- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b59d0 msgr2=0x7ff920149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9200b59d0 0x7ff920149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 -- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9201417d0 msgr2=0x7ff920151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9201417d0 0x7ff920151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9201e42d0 con 0x7ff9200b77b0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91ffff640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 0x7ff9201e3d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff91400ec10 tx=0x7ff91400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914017070 con 0x7ff9200b77b0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91400cc30 con 0x7ff9200b77b0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9201e3590 con 0x7ff9200b77b0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914013470 con 0x7ff9200b77b0 2024-05-12T22:57:00.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff920144d90 con 0x7ff9200b77b0 2024-05-12T22:57:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff920145000 con 0x7ff9200b77b0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff91401a070 con 0x7ff9200b77b0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff90c0678c0 0x7ff90c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff914085bc0 con 0x7ff9200b77b0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff924c34640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff90c0678c0 0x7ff90c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7ff90c06fc40 0x7ff90c0720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff91400be50 con 0x7ff90c06fc40 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.096+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff91408c020 con 0x7ff9200b77b0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.100+0000 7ff925435640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7ff90c06fc40 0x7ff90c0720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.100+0000 7ff924c34640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff90c0678c0 0x7ff90c069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ad000 tx=0x7ff910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.100+0000 7ff925435640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7ff90c06fc40 0x7ff90c0720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.100+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== osd.0 v2:172.21.15.40:6808/415151301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff91400be50 con 0x7ff90c06fc40 2024-05-12T22:57:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 --> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff920068a40 con 0x7ff90c06fc40 2024-05-12T22:57:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff91d7fa640 1 -- 172.21.15.40:0/163787063 <== osd.0 v2:172.21.15.40:6808/415151301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff920068a40 con 0x7ff90c06fc40 2024-05-12T22:57:00.116 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:00.116 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:00.116 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:00.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7ff90c06fc40 msgr2=0x7ff90c0720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6808/415151301,v1:172.21.15.40:6809/415151301] conn(0x7ff90c06fc40 0x7ff90c0720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff90c0678c0 msgr2=0x7ff90c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff90c0678c0 0x7ff90c069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ad000 tx=0x7ff910008040 comp rx=0 tx=0).stop 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 msgr2=0x7ff9201e3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 --2- 172.21.15.40:0/163787063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9200b77b0 0x7ff9201e3d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff91400ec10 tx=0x7ff91400c520 comp rx=0 tx=0).stop 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff925435640 1 -- 172.21.15.40:0/163787063 reap_dead start 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 shutdown_connections 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 >> 172.21.15.40:0/163787063 conn(0x7ff9200bce30 msgr2=0x7ff9200b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 shutdown_connections 2024-05-12T22:57:00.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.112+0000 7ff926e98640 1 -- 172.21.15.40:0/163787063 wait complete. 2024-05-12T22:57:00.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-12T22:57:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 Processor -- start 2024-05-12T22:57:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 -- start start 2024-05-12T22:57:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fac10148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac100b6150 con 0x7fac1013f760 2024-05-12T22:57:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1006f620 con 0x7fac100b2c50 2024-05-12T22:57:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac14950640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fac1006f990 con 0x7fac100b5d70 2024-05-12T22:57:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fac1013f760 0x7fac1014fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36870/0 (socket says 172.21.15.40:36870) 2024-05-12T22:57:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0ed9d640 1 -- 172.21.15.40:0/4215920160 learned_addr learned my addr 172.21.15.40:0/4215920160 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0e59c640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fac10148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200423743 0 0) 0x7fac100b6150 con 0x7fac1013f760 2024-05-12T22:57:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf8003530 con 0x7fac1013f760 2024-05-12T22:57:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804909000 0 0) 0x7fabf8003530 con 0x7fac1013f760 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 msgr2=0x7fac10148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fac10148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 >> v1:172.21.15.47:6789/0 conn(0x7fac100b2c50 legacy=0x7fac1013f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac100b4ea0 con 0x7fac1013f760 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fac08001a00 con 0x7fac1013f760 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 >> v1:172.21.15.40:6789/0 conn(0x7fac1013f760 legacy=0x7fac1014fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fabf80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fabf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabf8004d50 0x7fabf80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800bab0 con 0x7fabf8003f30 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800bc60 con 0x7fabf8004d50 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fabf800be60 con 0x7fac100b5d70 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fabf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0e59c640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fabf80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0ed9d640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabf8004d50 0x7fabf80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 -- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 msgr2=0x7fabf80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100b5d70 0x7fabf80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 -- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabf8004d50 msgr2=0x7fabf80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabf8004d50 0x7fabf80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0dd9b640 1 -- 172.21.15.40:0/4215920160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf8003530 con 0x7fabf8003f30 2024-05-12T22:57:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.248+0000 7fac0ed9d640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabf8004d50 0x7fabf80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fabf8004810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac04001910 tx=0x7fac0401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12650aca85bb128e server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040b5070 con 0x7fabf8003f30 2024-05-12T22:57:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac040a8910 con 0x7fabf8003f30 2024-05-12T22:57:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac0d59a640 1 -- 172.21.15.40:0/4215920160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04001510 con 0x7fabf8003f30 2024-05-12T22:57:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- 172.21.15.40:0/4215920160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 msgr2=0x7fabf8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 --2- 172.21.15.40:0/4215920160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fabf8004810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac04001910 tx=0x7fac0401ecd0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac0ed9d640 1 -- 172.21.15.40:0/4215920160 reap_dead start 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- 172.21.15.40:0/4215920160 shutdown_connections 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- 172.21.15.40:0/4215920160 >> 172.21.15.40:0/4215920160 conn(0x7fac1006b6c0 msgr2=0x7fac1006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- 172.21.15.40:0/4215920160 shutdown_connections 2024-05-12T22:57:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- 172.21.15.40:0/4215920160 wait complete. 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 Processor -- start 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.252+0000 7fac14950640 1 -- start start 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100725d0 0x7fac100b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac100b7fa0 0x7fac100b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fac10148960 con 0x7fabf8003f30 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fac100708b0 con 0x7fac100b7fa0 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fac10148ae0 con 0x7fac100725d0 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45212/0 (socket says 172.21.15.40:45212) 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 -- 172.21.15.40:0/2768713762 learned_addr learned my addr 172.21.15.40:0/2768713762 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 -- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100725d0 msgr2=0x7fac100b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100725d0 0x7fac100b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 -- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac100b7fa0 msgr2=0x7fac100b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac100b7fa0 0x7fac100b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 -- 172.21.15.40:0/2768713762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac10139960 con 0x7fabf8003f30 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0e59c640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac00011610 tx=0x7fac00011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0000f8f0 con 0x7fabf8003f30 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0000fa90 con 0x7fabf8003f30 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac100b8a40 con 0x7fabf8003f30 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0000fe40 con 0x7fabf8003f30 2024-05-12T22:57:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac100b9800 con 0x7fabf8003f30 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac10068330 con 0x7fabf8003f30 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac00015460 con 0x7fabf8003f30 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 0x7fabf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fac00086630 con 0x7fabf8003f30 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 0x7fabf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.256+0000 7fac0dd9b640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 0x7fabf0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac040b2000 tx=0x7fac040012c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.260+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fac00019030 con 0x7fabf8003f30 2024-05-12T22:57:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.424+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fac100b91e0 con 0x7fabf00678c0 2024-05-12T22:57:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fabfeffd640 1 -- 172.21.15.40:0/2768713762 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac100b91e0 con 0x7fabf00678c0 2024-05-12T22:57:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 msgr2=0x7fabf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 0x7fabf0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac040b2000 tx=0x7fac040012c0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 msgr2=0x7fac101391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac00011610 tx=0x7fac00011ad0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 shutdown_connections 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fabf00678c0 0x7fabf0069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac100b7fa0 0x7fac100b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac100725d0 0x7fac100b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 --2- 172.21.15.40:0/2768713762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf8003f30 0x7fac101391f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 >> 172.21.15.40:0/2768713762 conn(0x7fac1006b6c0 msgr2=0x7fac101435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 shutdown_connections 2024-05-12T22:57:00.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.428+0000 7fac14950640 1 -- 172.21.15.40:0/2768713762 wait complete. 2024-05-12T22:57:00.448 INFO:tasks.ceph:Scrubbing osd.1 2024-05-12T22:57:00.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 Processor -- start 2024-05-12T22:57:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 -- start start 2024-05-12T22:57:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2eb81422a0 0x7f2eb8142730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2eb8148860 0x7f2eb8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb81491f0 con 0x7f2eb80b5d70 2024-05-12T22:57:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb8142c70 con 0x7f2eb81422a0 2024-05-12T22:57:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2ebde01640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb80b6150 con 0x7f2eb8148860 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2eb81422a0 0x7f2eb8142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2eb81422a0 0x7f2eb8142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45218/0 (socket says 172.21.15.40:45218) 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 -- 172.21.15.40:0/1967870220 learned_addr learned my addr 172.21.15.40:0/1967870220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb7fff640 1 --2- 172.21.15.40:0/1967870220 >> v2:172.21.15.47:3300/0 conn(0x7f2eb8148860 0x7f2eb8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 -- 172.21.15.40:0/1967870220 >> v2:172.21.15.47:3300/0 conn(0x7f2eb8148860 msgr2=0x7f2eb8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/1967870220 >> v2:172.21.15.47:3300/0 conn(0x7f2eb8148860 0x7f2eb8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 -- 172.21.15.40:0/1967870220 >> v1:172.21.15.47:6789/0 conn(0x7f2eb80b5d70 legacy=0x7f2eb80b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.576+0000 7f2eb6ffd640 1 -- 172.21.15.40:0/1967870220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb80b4e70 con 0x7f2eb81422a0 2024-05-12T22:57:00.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/1967870220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb81422a0 0x7f2eb8142730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80736d0 tx=0x7f2eac01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ac7b08a8d34bf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2eb67fc640 1 -- 172.21.15.40:0/1967870220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b0070 con 0x7f2eb81422a0 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2eb67fc640 1 -- 172.21.15.40:0/1967870220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ab600 con 0x7f2eb81422a0 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2eb67fc640 1 -- 172.21.15.40:0/1967870220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ab9d0 con 0x7f2eb81422a0 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 -- 172.21.15.40:0/1967870220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb81422a0 msgr2=0x7f2eb8142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 --2- 172.21.15.40:0/1967870220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb81422a0 0x7f2eb8142730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80736d0 tx=0x7f2eac01c400 comp rx=0 tx=0).stop 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 -- 172.21.15.40:0/1967870220 shutdown_connections 2024-05-12T22:57:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 --2- 172.21.15.40:0/1967870220 >> v2:172.21.15.47:3300/0 conn(0x7f2eb8148860 0x7f2eb8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 --2- 172.21.15.40:0/1967870220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb81422a0 0x7f2eb8142730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 -- 172.21.15.40:0/1967870220 >> 172.21.15.40:0/1967870220 conn(0x7f2eb806b6c0 msgr2=0x7f2eb806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 -- 172.21.15.40:0/1967870220 shutdown_connections 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.580+0000 7f2ebde01640 1 -- 172.21.15.40:0/1967870220 wait complete. 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 Processor -- start 2024-05-12T22:57:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- start start 2024-05-12T22:57:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 0x7f2eb80b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb81422a0 0x7f2eb8147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb8148860 0x7f2eb8134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8150780 con 0x7f2eb80b5d70 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8150600 con 0x7f2eb8148860 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb8150900 con 0x7f2eb81422a0 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 0x7f2eb80b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 0x7f2eb80b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45220/0 (socket says 172.21.15.40:45220) 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 -- 172.21.15.40:0/2287194003 learned_addr learned my addr 172.21.15.40:0/2287194003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb81422a0 0x7f2eb8147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb7fff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb8148860 0x7f2eb8134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 -- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb81422a0 msgr2=0x7f2eb8147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb81422a0 0x7f2eb8147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 -- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb8148860 msgr2=0x7f2eb8134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb8148860 0x7f2eb8134cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb813b380 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb7fff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb8148860 0x7f2eb8134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb81422a0 0x7f2eb8147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2eb77fe640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 0x7f2eb80b7cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800c370 tx=0x7f2ea800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80052d0 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea8005470 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb813bb40 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007260 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb813b0a0 con 0x7f2eb80b5d70 2024-05-12T22:57:00.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2eb8068330 con 0x7f2eb80b5d70 2024-05-12T22:57:00.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.584+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ea8007400 con 0x7f2eb80b5d70 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ea40678c0 0x7f2ea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2ea8085970 con 0x7f2eb80b5d70 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ea40678c0 0x7f2ea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7f2ea406fc40 0x7f2ea40720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ea4072790 con 0x7f2ea406fc40 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2ea8085e00 con 0x7f2eb80b5d70 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2eb7fff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7f2ea406fc40 0x7f2ea40720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2eb6ffd640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ea40678c0 0x7f2ea4069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ad000 tx=0x7f2eac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2eb7fff640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7f2ea406fc40 0x7f2ea40720c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.588+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== osd.1 v2:172.21.15.40:6816/4284490578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ea4072790 con 0x7f2ea406fc40 2024-05-12T22:57:00.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 --> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2eb814f940 con 0x7f2ea406fc40 2024-05-12T22:57:00.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2e9ffff640 1 -- 172.21.15.40:0/2287194003 <== osd.1 v2:172.21.15.40:6816/4284490578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2eb814f940 con 0x7f2ea406fc40 2024-05-12T22:57:00.604 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:00.604 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:00.605 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:00.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7f2ea406fc40 msgr2=0x7f2ea40720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6816/4284490578,v1:172.21.15.40:6817/4284490578] conn(0x7f2ea406fc40 0x7f2ea40720c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ea40678c0 msgr2=0x7f2ea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ea40678c0 0x7f2ea4069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ad000 tx=0x7f2eac008040 comp rx=0 tx=0).stop 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 msgr2=0x7f2eb80b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 --2- 172.21.15.40:0/2287194003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eb80b5d70 0x7f2eb80b7cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800c370 tx=0x7f2ea800c830 comp rx=0 tx=0).stop 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2eb7fff640 1 -- 172.21.15.40:0/2287194003 reap_dead start 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 shutdown_connections 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 >> 172.21.15.40:0/2287194003 conn(0x7f2eb806b6c0 msgr2=0x7f2eb8145250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 shutdown_connections 2024-05-12T22:57:00.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.600+0000 7f2ebde01640 1 -- 172.21.15.40:0/2287194003 wait complete. 2024-05-12T22:57:00.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-12T22:57:00.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 Processor -- start 2024-05-12T22:57:00.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 -- start start 2024-05-12T22:57:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb974148460 0x7fb9740b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 0x7fb97413e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9740b6150 con 0x7fb9740b5d70 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb974147fd0 con 0x7fb974148460 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb979de3640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb97406f7e0 con 0x7fb97413df10 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb974148460 0x7fb9740b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb9737fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb9740b5d70 0x7fb974144270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36876/0 (socket says 172.21.15.40:36876) 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb9737fe640 1 -- 172.21.15.40:0/3943816755 learned_addr learned my addr 172.21.15.40:0/3943816755 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb974148460 0x7fb9740b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45234/0 (socket says 172.21.15.40:45234) 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb973fff640 1 --2- 172.21.15.40:0/3943816755 >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 0x7fb97413e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 -- 172.21.15.40:0/3943816755 >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 msgr2=0x7fb97413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 --2- 172.21.15.40:0/3943816755 >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 0x7fb97413e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 -- 172.21.15.40:0/3943816755 >> v1:172.21.15.40:6789/0 conn(0x7fb9740b5d70 legacy=0x7fb974144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb96bfff640 1 -- 172.21.15.40:0/3943816755 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974147980 con 0x7fb974148460 2024-05-12T22:57:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb972ffd640 1 -- 172.21.15.40:0/3943816755 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743486819 0 0) 0x7fb9740b6150 con 0x7fb9740b5d70 2024-05-12T22:57:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.736+0000 7fb973fff640 1 --2- 172.21.15.40:0/3943816755 >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 0x7fb97413e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb96bfff640 1 --2- 172.21.15.40:0/3943816755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974148460 0x7fb9740b4e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb9741453a0 tx=0x7fb95c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed4bae80524cb0d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb972ffd640 1 -- 172.21.15.40:0/3943816755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0b0070 con 0x7fb974148460 2024-05-12T22:57:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb972ffd640 1 -- 172.21.15.40:0/3943816755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c0ab600 con 0x7fb974148460 2024-05-12T22:57:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb972ffd640 1 -- 172.21.15.40:0/3943816755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab9d0 con 0x7fb974148460 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- 172.21.15.40:0/3943816755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974148460 msgr2=0x7fb9740b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 --2- 172.21.15.40:0/3943816755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974148460 0x7fb9740b4e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb9741453a0 tx=0x7fb95c01c3c0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- 172.21.15.40:0/3943816755 shutdown_connections 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 --2- 172.21.15.40:0/3943816755 >> v2:172.21.15.47:3300/0 conn(0x7fb97413df10 0x7fb97413e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 --2- 172.21.15.40:0/3943816755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974148460 0x7fb9740b4e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- 172.21.15.40:0/3943816755 >> 172.21.15.40:0/3943816755 conn(0x7fb97406b6c0 msgr2=0x7fb97406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- 172.21.15.40:0/3943816755 shutdown_connections 2024-05-12T22:57:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- 172.21.15.40:0/3943816755 wait complete. 2024-05-12T22:57:00.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 Processor -- start 2024-05-12T22:57:00.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 -- start start 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 0x7fb9741dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.740+0000 7fb979de3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb974148460 0x7fb97413fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740b3790 con 0x7fb97413df10 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740b3610 con 0x7fb9740b5d70 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740b3910 con 0x7fb974148460 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45244/0 (socket says 172.21.15.40:45244) 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 -- 172.21.15.40:0/1134487435 learned_addr learned my addr 172.21.15.40:0/1134487435 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb9737fe640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 0x7fb9741dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb973fff640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb974148460 0x7fb97413fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 -- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb974148460 msgr2=0x7fb97413fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb974148460 0x7fb97413fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 -- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 msgr2=0x7fb9741dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 0x7fb9741dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 -- 172.21.15.40:0/1134487435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9741416e0 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb9737fe640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 0x7fb9741dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb96bfff640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb95c019ff0 tx=0x7fb95c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0bb070 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c0b7460 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9741df3d0 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0b0040 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb974073060 con 0x7fb97413df10 2024-05-12T22:57:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb974068330 con 0x7fb97413df10 2024-05-12T22:57:00.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb95c0be070 con 0x7fb97413df10 2024-05-12T22:57:00.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 0x7fb954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:00.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb95c1206e0 con 0x7fb97413df10 2024-05-12T22:57:00.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb9737fe640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 0x7fb954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:00.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.744+0000 7fb9737fe640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 0x7fb954069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb964007fd0 tx=0x7fb964007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:00.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.748+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb95c016070 con 0x7fb97413df10 2024-05-12T22:57:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.912+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb974141480 con 0x7fb9540678c0 2024-05-12T22:57:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.912+0000 7fb970ff9640 1 -- 172.21.15.40:0/1134487435 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb964005c90 con 0x7fb9540678c0 2024-05-12T22:57:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 msgr2=0x7fb954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 0x7fb954069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb964007fd0 tx=0x7fb964007c20 comp rx=0 tx=0).stop 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 msgr2=0x7fb974140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb95c019ff0 tx=0x7fb95c019160 comp rx=0 tx=0).stop 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 shutdown_connections 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb974148460 0x7fb97413fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97413df10 0x7fb974140f40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fb9540678c0 0x7fb954069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 --2- 172.21.15.40:0/1134487435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9740b5d70 0x7fb9741dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 >> 172.21.15.40:0/1134487435 conn(0x7fb97406b6c0 msgr2=0x7fb97413d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 shutdown_connections 2024-05-12T22:57:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:00.916+0000 7fb979de3640 1 -- 172.21.15.40:0/1134487435 wait complete. 2024-05-12T22:57:00.935 INFO:tasks.ceph:Scrubbing osd.2 2024-05-12T22:57:00.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 Processor -- start 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 -- start start 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa54c14b440 0x7fa54c141850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c0bdb50 con 0x7fa54c0b4910 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa54c0b9530 con 0x7fa54c14b440 2024-05-12T22:57:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa5546a6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c0b5420 con 0x7fa54c0bd770 2024-05-12T22:57:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.40:51206/0 (socket says 172.21.15.40:51206) 2024-05-12T22:57:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 -- 172.21.15.40:0/3699494863 learned_addr learned my addr 172.21.15.40:0/3699494863 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552c43640 1 --2- 172.21.15.40:0/3699494863 >> v2:172.21.15.47:3300/0 conn(0x7fa54c14b440 0x7fa54c141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 -- 172.21.15.40:0/3699494863 >> v2:172.21.15.47:3300/0 conn(0x7fa54c14b440 msgr2=0x7fa54c141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 --2- 172.21.15.40:0/3699494863 >> v2:172.21.15.47:3300/0 conn(0x7fa54c14b440 0x7fa54c141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 -- 172.21.15.40:0/3699494863 >> v1:172.21.15.47:6789/0 conn(0x7fa54c0b4910 legacy=0x7fa54c14ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.056+0000 7fa552442640 1 -- 172.21.15.40:0/3699494863 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c0b5700 con 0x7fa54c0bd770 2024-05-12T22:57:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa552442640 1 --2- 172.21.15.40:0/3699494863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa544009e50 tx=0x7fa54401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541e210f3ba1d9dd server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa551440640 1 -- 172.21.15.40:0/3699494863 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440a5740 con 0x7fa54c0bd770 2024-05-12T22:57:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa551440640 1 -- 172.21.15.40:0/3699494863 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5440a58e0 con 0x7fa54c0bd770 2024-05-12T22:57:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa551440640 1 -- 172.21.15.40:0/3699494863 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440a5cb0 con 0x7fa54c0bd770 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 -- 172.21.15.40:0/3699494863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 msgr2=0x7fa54c141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 --2- 172.21.15.40:0/3699494863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa544009e50 tx=0x7fa54401c970 comp rx=0 tx=0).stop 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 -- 172.21.15.40:0/3699494863 shutdown_connections 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 --2- 172.21.15.40:0/3699494863 >> v2:172.21.15.47:3300/0 conn(0x7fa54c14b440 0x7fa54c141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 --2- 172.21.15.40:0/3699494863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0bd770 0x7fa54c141310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 -- 172.21.15.40:0/3699494863 >> 172.21.15.40:0/3699494863 conn(0x7fa54c072ff0 msgr2=0x7fa54c0bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 -- 172.21.15.40:0/3699494863 shutdown_connections 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.060+0000 7fa5546a6640 1 -- 172.21.15.40:0/3699494863 wait complete. 2024-05-12T22:57:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 Processor -- start 2024-05-12T22:57:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- start start 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0b4910 0x7fa54c13c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa54c0bd770 0x7fa54c145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 0x7fa54c1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c154640 con 0x7fa54c14b440 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c0b5060 con 0x7fa54c0bd770 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c1547c0 con 0x7fa54c0b4910 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 0x7fa54c1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 0x7fa54c1e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45254/0 (socket says 172.21.15.40:45254) 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 -- 172.21.15.40:0/1249632495 learned_addr learned my addr 172.21.15.40:0/1249632495 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa551c41640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa54c0bd770 0x7fa54c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552442640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0b4910 0x7fa54c13c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 -- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0b4910 msgr2=0x7fa54c13c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa54c0b4910 0x7fa54c13c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 -- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa54c0bd770 msgr2=0x7fa54c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa54c0bd770 0x7fa54c145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c149dd0 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa552c43640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 0x7fa54c1e34e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00e820 tx=0x7fa53c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c017070 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c00c940 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c138800 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00cd10 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54c149a60 con 0x7fa54c14b440 2024-05-12T22:57:01.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa54c068330 con 0x7fa54c14b440 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.064+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa53c01a070 con 0x7fa54c14b440 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa5380678c0 0x7fa538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa53c085ee0 con 0x7fa54c14b440 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa552442640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa5380678c0 0x7fa538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7fa53806fc40 0x7fa5380720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa538072790 con 0x7fa53806fc40 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa53c086370 con 0x7fa54c14b440 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa551c41640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7fa53806fc40 0x7fa5380720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa552442640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa5380678c0 0x7fa538069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ae000 tx=0x7fa5440a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa551c41640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7fa53806fc40 0x7fa5380720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.068+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== osd.2 v2:172.21.15.40:6800/931675717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa538072790 con 0x7fa53806fc40 2024-05-12T22:57:01.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 --> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa54c14a2f0 con 0x7fa53806fc40 2024-05-12T22:57:01.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa54affd640 1 -- 172.21.15.40:0/1249632495 <== osd.2 v2:172.21.15.40:6800/931675717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa5400050e0 con 0x7fa53806fc40 2024-05-12T22:57:01.085 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:01.085 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:01.085 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7fa53806fc40 msgr2=0x7fa5380720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6800/931675717,v1:172.21.15.40:6801/931675717] conn(0x7fa53806fc40 0x7fa5380720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa5380678c0 msgr2=0x7fa538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa5380678c0 0x7fa538069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5440ae000 tx=0x7fa5440a7070 comp rx=0 tx=0).stop 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 msgr2=0x7fa54c1e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 --2- 172.21.15.40:0/1249632495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa54c14b440 0x7fa54c1e34e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00e820 tx=0x7fa53c00ece0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa552c43640 1 -- 172.21.15.40:0/1249632495 reap_dead start 2024-05-12T22:57:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 shutdown_connections 2024-05-12T22:57:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 >> 172.21.15.40:0/1249632495 conn(0x7fa54c072ff0 msgr2=0x7fa54c0b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 shutdown_connections 2024-05-12T22:57:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.080+0000 7fa5546a6640 1 -- 172.21.15.40:0/1249632495 wait complete. 2024-05-12T22:57:01.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-12T22:57:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 Processor -- start 2024-05-12T22:57:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 -- start start 2024-05-12T22:57:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c40b57b0 0x7f50c413f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c4071530 con 0x7f50c4072d20 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c4145390 con 0x7f50c40b7730 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c8bed640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f50c40b7e80 con 0x7f50c40b57b0 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50c4072d20 0x7f50c414fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36892/0 (socket says 172.21.15.40:36892) 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 -- 172.21.15.40:0/1664762979 learned_addr learned my addr 172.21.15.40:0/1664762979 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50b9d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c40b57b0 0x7f50c413f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637868688 0 0) 0x7f50c4071530 con 0x7f50c4072d20 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a4003530 con 0x7f50c4072d20 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1954841424 0 0) 0x7f50a4003530 con 0x7f50c4072d20 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c40b57b0 msgr2=0x7f50c413f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c40b57b0 0x7f50c413f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 >> v1:172.21.15.47:6789/0 conn(0x7f50c40b7730 legacy=0x7f50c4145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c40b5c40 con 0x7f50c4072d20 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f50bc001a00 con 0x7f50c4072d20 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 >> v1:172.21.15.40:6789/0 conn(0x7f50c4072d20 legacy=0x7f50c414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50a40039f0 0x7f50a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50a4004810 0x7f50a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50c40b7e80 con 0x7f50a4005190 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50a400bf10 con 0x7f50a40039f0 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f50a400c0e0 con 0x7f50a4004810 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c259c640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50a40039f0 0x7f50a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50b9d9b640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50a4004810 0x7f50a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 -- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50a4004810 msgr2=0x7f50a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50a4004810 0x7f50a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 -- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50a40039f0 msgr2=0x7f50a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50a40039f0 0x7f50a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c2d9d640 1 -- 172.21.15.40:0/1664762979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a4003530 con 0x7f50a4005190 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.216+0000 7f50c259c640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50a40039f0 0x7f50a4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50a400b9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00a800 tx=0x7f50bc01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a6bb1b21f44d51 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00a450 con 0x7f50a4005190 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc0ad650 con 0x7f50a4005190 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c1d9b640 1 -- 172.21.15.40:0/1664762979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0ada40 con 0x7f50a4005190 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- 172.21.15.40:0/1664762979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 msgr2=0x7f50a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 --2- 172.21.15.40:0/1664762979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50a400b9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00a800 tx=0x7f50bc01d300 comp rx=0 tx=0).stop 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c2d9d640 1 -- 172.21.15.40:0/1664762979 reap_dead start 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- 172.21.15.40:0/1664762979 shutdown_connections 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- 172.21.15.40:0/1664762979 >> 172.21.15.40:0/1664762979 conn(0x7f50c406e5e0 msgr2=0x7f50c406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- 172.21.15.40:0/1664762979 shutdown_connections 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- 172.21.15.40:0/1664762979 wait complete. 2024-05-12T22:57:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 Processor -- start 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.220+0000 7f50c8bed640 1 -- start start 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c41dd4a0 0x7f50c41dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 0x7f50c41368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50c40b7b10 con 0x7f50a4005190 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4146280 con 0x7f50c4136460 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f50c40b7c90 con 0x7f50c41dd4a0 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45266/0 (socket says 172.21.15.40:45266) 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 -- 172.21.15.40:0/3370701317 learned_addr learned my addr 172.21.15.40:0/3370701317 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 0x7f50c41368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50b9d9b640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c41dd4a0 0x7f50c41dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 -- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c41dd4a0 msgr2=0x7f50c41dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c41dd4a0 0x7f50c41dd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 -- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 msgr2=0x7f50c41368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 0x7f50c41368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 -- 172.21.15.40:0/3370701317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c4143e70 con 0x7f50a4005190 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c2d9d640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 0x7f50c41368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c259c640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50ac010f70 tx=0x7f50ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac018020 con 0x7f50a4005190 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac005070 con 0x7f50a4005190 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c4143390 con 0x7f50a4005190 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac005460 con 0x7f50a4005190 2024-05-12T22:57:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c4143950 con 0x7f50a4005190 2024-05-12T22:57:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c4143b50 con 0x7f50a4005190 2024-05-12T22:57:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50ac01b020 con 0x7f50a4005190 2024-05-12T22:57:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 0x7f50a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50b9d9b640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 0x7f50a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f50ac089440 con 0x7f50a4005190 2024-05-12T22:57:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.224+0000 7f50b9d9b640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 0x7f50a8069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50c40b9970 tx=0x7f50b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.228+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f50c4143b50 con 0x7f50a4005190 2024-05-12T22:57:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f50c4068a40 con 0x7f50a80678c0 2024-05-12T22:57:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50bb7fe640 1 -- 172.21.15.40:0/3370701317 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50c4068a40 con 0x7f50a80678c0 2024-05-12T22:57:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 msgr2=0x7f50a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 0x7f50a8069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50c40b9970 tx=0x7f50b4008040 comp rx=0 tx=0).stop 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 msgr2=0x7f50c413a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f50ac010f70 tx=0x7f50ac00e530 comp rx=0 tx=0).stop 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 shutdown_connections 2024-05-12T22:57:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f50a80678c0 0x7f50a8069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50c4136460 0x7f50c41368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50c41dd4a0 0x7f50c41dd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 --2- 172.21.15.40:0/3370701317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50a4005190 0x7f50c413a630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 >> 172.21.15.40:0/3370701317 conn(0x7f50c406e5e0 msgr2=0x7f50c413f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 shutdown_connections 2024-05-12T22:57:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.404+0000 7f50c8bed640 1 -- 172.21.15.40:0/3370701317 wait complete. 2024-05-12T22:57:01.428 INFO:tasks.ceph:Scrubbing osd.3 2024-05-12T22:57:01.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 Processor -- start 2024-05-12T22:57:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 -- start start 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d40672d0 0x7f42d4072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d4145af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d40676b0 con 0x7f42d413f090 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f42d4146030 con 0x7f42d40672d0 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d98ad640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f42d4072f50 con 0x7f42d41456b0 2024-05-12T22:57:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d40672d0 0x7f42d4072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d40672d0 0x7f42d4072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45268/0 (socket says 172.21.15.40:45268) 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 -- 172.21.15.40:0/2154840496 learned_addr learned my addr 172.21.15.40:0/2154840496 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d27fc640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d4145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 -- 172.21.15.40:0/2154840496 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 msgr2=0x7f42d4145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d4145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 -- 172.21.15.40:0/2154840496 >> v1:172.21.15.47:6789/0 conn(0x7f42d413f090 legacy=0x7f42d413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d2ffd640 1 -- 172.21.15.40:0/2154840496 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d4073230 con 0x7f42d40672d0 2024-05-12T22:57:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.548+0000 7f42d27fc640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d4145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d2ffd640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d4072930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009e50 tx=0x7f42c401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672db4b436d6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d1ffb640 1 -- 172.21.15.40:0/2154840496 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40a5660 con 0x7f42d40672d0 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d1ffb640 1 -- 172.21.15.40:0/2154840496 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c40a5800 con 0x7f42d40672d0 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d1ffb640 1 -- 172.21.15.40:0/2154840496 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40a5bd0 con 0x7f42d40672d0 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 -- 172.21.15.40:0/2154840496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 msgr2=0x7f42d4072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d4072930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009e50 tx=0x7f42c401c8d0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 -- 172.21.15.40:0/2154840496 shutdown_connections 2024-05-12T22:57:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d4145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 --2- 172.21.15.40:0/2154840496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d4072930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 -- 172.21.15.40:0/2154840496 >> 172.21.15.40:0/2154840496 conn(0x7f42d406b2c0 msgr2=0x7f42d406b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 -- 172.21.15.40:0/2154840496 shutdown_connections 2024-05-12T22:57:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.552+0000 7f42d98ad640 1 -- 172.21.15.40:0/2154840496 wait complete. 2024-05-12T22:57:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 Processor -- start 2024-05-12T22:57:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- start start 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d41e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42d413f090 0x7f42d40b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d41dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4152480 con 0x7f42d40672d0 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42d406c970 con 0x7f42d413f090 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f42d4152600 con 0x7f42d41456b0 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d41e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d41e17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45276/0 (socket says 172.21.15.40:45276) 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 -- 172.21.15.40:0/3984624193 learned_addr learned my addr 172.21.15.40:0/3984624193 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d37fe640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d41dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d27fc640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42d413f090 0x7f42d40b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 -- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 msgr2=0x7f42d41dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42d41456b0 0x7f42d41dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 -- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42d413f090 msgr2=0x7f42d40b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42d413f090 0x7f42d40b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d41e0cd0 con 0x7f42d40672d0 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d2ffd640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d41e17b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42c401af80 tx=0x7f42c4019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40bc020 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c40b8670 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d41e0fb0 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40b8a60 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d414f880 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42d4068a40 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42c40bf020 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f42c00678c0 0x7f42c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f42c41211d0 con 0x7f42d40672d0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d27fc640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f42c00678c0 0x7f42c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7f42c006fbe0 0x7f42c0072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42c0072730 con 0x7f42c006fbe0 2024-05-12T22:57:01.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f42c4121660 con 0x7f42d40672d0 2024-05-12T22:57:01.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.556+0000 7f42d37fe640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7f42c006fbe0 0x7f42c0072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.560+0000 7f42d27fc640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f42c00678c0 0x7f42c0069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f42d4139270 tx=0x7f42c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.560+0000 7f42d37fe640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7f42c006fbe0 0x7f42c0072060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.560+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== osd.3 v2:172.21.15.40:6824/2549687319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42c0072730 con 0x7f42c006fbe0 2024-05-12T22:57:01.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 --> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42d413dca0 con 0x7f42c006fbe0 2024-05-12T22:57:01.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42bbfff640 1 -- 172.21.15.40:0/3984624193 <== osd.3 v2:172.21.15.40:6824/2549687319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42d413dca0 con 0x7f42c006fbe0 2024-05-12T22:57:01.576 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:01.576 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:01.576 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7f42c006fbe0 msgr2=0x7f42c0072060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6824/2549687319,v1:172.21.15.40:6825/2549687319] conn(0x7f42c006fbe0 0x7f42c0072060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f42c00678c0 msgr2=0x7f42c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f42c00678c0 0x7f42c0069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f42d4139270 tx=0x7f42c8008040 comp rx=0 tx=0).stop 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 msgr2=0x7f42d41e17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 --2- 172.21.15.40:0/3984624193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d40672d0 0x7f42d41e17b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42c401af80 tx=0x7f42c4019670 comp rx=0 tx=0).stop 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d37fe640 1 -- 172.21.15.40:0/3984624193 reap_dead start 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 shutdown_connections 2024-05-12T22:57:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 >> 172.21.15.40:0/3984624193 conn(0x7f42d406b2c0 msgr2=0x7f42d406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 shutdown_connections 2024-05-12T22:57:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.572+0000 7f42d98ad640 1 -- 172.21.15.40:0/3984624193 wait complete. 2024-05-12T22:57:01.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-12T22:57:01.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 Processor -- start 2024-05-12T22:57:01.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 -- start start 2024-05-12T22:57:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff52c067330 0x7ff52c0ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c0afef0 con 0x7ff52c144b50 2024-05-12T22:57:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c0b5b20 con 0x7ff52c1446a0 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff533a27640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff52c067710 con 0x7ff52c067330 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff531fc4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff52c144b50 0x7ff52c0b5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36906/0 (socket says 172.21.15.40:36906) 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff531fc4640 1 -- 172.21.15.40:0/3401886737 learned_addr learned my addr 172.21.15.40:0/3401886737 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff5317c3640 1 --2- 172.21.15.40:0/3401886737 >> v2:172.21.15.47:3300/0 conn(0x7ff52c067330 0x7ff52c0ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640609565 0 0) 0x7ff5240014a0 con 0x7ff52c144b50 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff518003530 con 0x7ff52c144b50 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2276081065 0 0) 0x7ff518003530 con 0x7ff52c144b50 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 >> v2:172.21.15.47:3300/0 conn(0x7ff52c067330 msgr2=0x7ff52c0ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 --2- 172.21.15.40:0/3401886737 >> v2:172.21.15.47:3300/0 conn(0x7ff52c067330 0x7ff52c0ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 >> v1:172.21.15.47:6789/0 conn(0x7ff52c1446a0 legacy=0x7ff52c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c0afc10 con 0x7ff52c144b50 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7ff524001bd0 con 0x7ff52c144b50 2024-05-12T22:57:01.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 >> v1:172.21.15.40:6789/0 conn(0x7ff52c144b50 legacy=0x7ff52c0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff5180039c0 0x7ff518003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 0x7ff518004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5180052f0 0x7ff51800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c067710 con 0x7ff518004810 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff51800c1c0 con 0x7ff5180052f0 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff51800c3c0 con 0x7ff5180039c0 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 0x7ff518004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff531fc4640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5180052f0 0x7ff51800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff5317c3640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff5180039c0 0x7ff518003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 -- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff5180039c0 msgr2=0x7ff518003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff5180039c0 0x7ff518003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 -- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5180052f0 msgr2=0x7ff51800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5180052f0 0x7ff51800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff530fc2640 1 -- 172.21.15.40:0/3401886737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff518003530 con 0x7ff518004810 2024-05-12T22:57:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff531fc4640 1 -- 172.21.15.40:0/3401886737 reap_dead start 2024-05-12T22:57:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.708+0000 7ff5317c3640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff5180039c0 0x7ff518003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 0x7ff518004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff520001750 tx=0x7ff52001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f024859e1b0c28a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200013a0 con 0x7ff518004810 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5200052f0 con 0x7ff518004810 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff51ffff640 1 -- 172.21.15.40:0/3401886737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200a4e60 con 0x7ff518004810 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 msgr2=0x7ff518004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 0x7ff518004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff520001750 tx=0x7ff52001c3c0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- 172.21.15.40:0/3401886737 shutdown_connections 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 --2- 172.21.15.40:0/3401886737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff518004810 0x7ff518004c90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- 172.21.15.40:0/3401886737 >> 172.21.15.40:0/3401886737 conn(0x7ff52c06b2c0 msgr2=0x7ff52c06b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- 172.21.15.40:0/3401886737 shutdown_connections 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- 172.21.15.40:0/3401886737 wait complete. 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 Processor -- start 2024-05-12T22:57:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- start start 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff518004810 0x7ff52c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff52c1e09d0 0x7ff52c13a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c14ab20 con 0x7ff52c13f070 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c144f60 con 0x7ff52c1e09d0 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff533a27640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7ff52c0af7e0 con 0x7ff518004810 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45286/0 (socket says 172.21.15.40:45286) 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 -- 172.21.15.40:0/4159788975 learned_addr learned my addr 172.21.15.40:0/4159788975 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff531fc4640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff52c1e09d0 0x7ff52c13a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff5317c3640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff518004810 0x7ff52c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 -- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff518004810 msgr2=0x7ff52c149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff518004810 0x7ff52c149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 -- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff52c1e09d0 msgr2=0x7ff52c13a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff52c1e09d0 0x7ff52c13a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 -- 172.21.15.40:0/4159788975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c070cd0 con 0x7ff52c13f070 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.712+0000 7ff530fc2640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff52001c1f0 tx=0x7ff518005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200b8020 con 0x7ff52c13f070 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5200054a0 con 0x7ff52c13f070 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c1e0e50 con 0x7ff52c13f070 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520007a40 con 0x7ff52c13f070 2024-05-12T22:57:01.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c06fd40 con 0x7ff52c13f070 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c068a40 con 0x7ff52c13f070 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5200bb020 con 0x7ff52c13f070 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 0x7ff510069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff52011fa70 con 0x7ff52c13f070 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff5317c3640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 0x7ff510069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:01.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.716+0000 7ff5317c3640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 0x7ff510069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff52c050fa0 tx=0x7ff528008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:01.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.720+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff5200c2030 con 0x7ff52c13f070 2024-05-12T22:57:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.876+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff52c143ff0 con 0x7ff5100678c0 2024-05-12T22:57:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.876+0000 7ff51dffb640 1 -- 172.21.15.40:0/4159788975 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff52c143ff0 con 0x7ff5100678c0 2024-05-12T22:57:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 msgr2=0x7ff510069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 0x7ff510069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff52c050fa0 tx=0x7ff528008040 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 msgr2=0x7ff52c1e0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff52001c1f0 tx=0x7ff518005840 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 shutdown_connections 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7ff5100678c0 0x7ff510069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff52c1e09d0 0x7ff52c13a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff52c13f070 0x7ff52c1e0490 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 --2- 172.21.15.40:0/4159788975 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff518004810 0x7ff52c149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 >> 172.21.15.40:0/4159788975 conn(0x7ff52c06b2c0 msgr2=0x7ff52c1466d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 shutdown_connections 2024-05-12T22:57:01.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:01.880+0000 7ff533a27640 1 -- 172.21.15.40:0/4159788975 wait complete. 2024-05-12T22:57:01.898 INFO:tasks.ceph:Scrubbing osd.4 2024-05-12T22:57:01.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 Processor -- start 2024-05-12T22:57:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 -- start start 2024-05-12T22:57:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ff40726e0 0x7f7ff40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b1e90 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b6150 con 0x7f7ff41442c0 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ffb688640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff40b52e0 con 0x7f7ff40726e0 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff9424640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ff40b5d70 0x7f7ff4071fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36914/0 (socket says 172.21.15.40:36914) 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff9424640 1 -- 172.21.15.40:0/2954705644 learned_addr learned my addr 172.21.15.40:0/2954705644 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff8c23640 1 --2- 172.21.15.40:0/2954705644 >> v2:172.21.15.47:3300/0 conn(0x7f7ff40726e0 0x7f7ff40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537356141 0 0) 0x7f7ff40b1e90 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe0003530 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3302327431 0 0) 0x7f7fe0003530 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 >> v2:172.21.15.47:3300/0 conn(0x7f7ff40726e0 msgr2=0x7f7ff40b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 --2- 172.21.15.40:0/2954705644 >> v2:172.21.15.47:3300/0 conn(0x7f7ff40726e0 0x7f7ff40b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 >> v1:172.21.15.47:6789/0 conn(0x7f7ff41442c0 legacy=0x7f7ff4144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff406f6b0 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f7ff0001680 con 0x7f7ff40b5d70 2024-05-12T22:57:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 >> v1:172.21.15.40:6789/0 conn(0x7f7ff40b5d70 legacy=0x7f7ff4071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fe00039c0 0x7f7fe0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fe0004810 0x7f7fe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7fe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40b52e0 con 0x7f7fe0005320 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe000c1f0 con 0x7f7fe0004810 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe000e600 con 0x7f7fe00039c0 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7fe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff9424640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fe00039c0 0x7f7fe0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.012+0000 7f7ff8c23640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fe0004810 0x7f7fe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 -- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fe00039c0 msgr2=0x7f7fe0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fe00039c0 0x7f7fe0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 -- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fe0004810 msgr2=0x7f7fe0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fe0004810 0x7f7fe0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 -- 172.21.15.40:0/2954705644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0003530 con 0x7f7fe0005320 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 -- 172.21.15.40:0/2954705644 reap_dead start 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7fe000b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fec001e70 tx=0x7f7fec01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cbe2ffec18f709 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec001a90 con 0x7f7fe0005320 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fec003ba0 con 0x7f7fe0005320 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7febfff640 1 -- 172.21.15.40:0/2954705644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0050d0 con 0x7f7fe0005320 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 -- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 msgr2=0x7f7fe000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7fe000b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fec001e70 tx=0x7f7fec01c780 comp rx=0 tx=0).stop 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 -- 172.21.15.40:0/2954705644 shutdown_connections 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 --2- 172.21.15.40:0/2954705644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7fe000b9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 -- 172.21.15.40:0/2954705644 >> 172.21.15.40:0/2954705644 conn(0x7f7ff406b6c0 msgr2=0x7f7ff406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 -- 172.21.15.40:0/2954705644 shutdown_connections 2024-05-12T22:57:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.016+0000 7f7ffb688640 1 -- 172.21.15.40:0/2954705644 wait complete. 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 Processor -- start 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- start start 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7ff40ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff40abbb0 0x7f7ff41db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff41dbef0 0x7f7ff40ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40b1c20 con 0x7f7fe0005320 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40b1aa0 con 0x7f7ff41dbef0 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff4071fd0 con 0x7f7ff40abbb0 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7ff40ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7ff40ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45304/0 (socket says 172.21.15.40:45304) 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 -- 172.21.15.40:0/3944639463 learned_addr learned my addr 172.21.15.40:0/3944639463 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff8c23640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff40abbb0 0x7f7ff41db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff41dbef0 0x7f7ff40ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 -- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff40abbb0 msgr2=0x7f7ff41db9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff40abbb0 0x7f7ff41db9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 -- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff41dbef0 msgr2=0x7f7ff40ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff41dbef0 0x7f7ff40ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff41dc370 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff41dbef0 0x7f7ff40ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff9424640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7ff40ab670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000e7b0 tx=0x7f7ff000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000c8d0 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff0018070 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff40aa690 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000cc90 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff40aa960 con 0x7f7fe0005320 2024-05-12T22:57:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ff40acd60 con 0x7f7fe0005320 2024-05-12T22:57:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ff001d460 con 0x7f7fe0005320 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7fd80678c0 0x7f7fd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7ff00864f0 con 0x7f7fe0005320 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7ff8c23640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7fd80678c0 0x7f7fd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7f7fd806fbe0 0x7f7fd8072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ff0015e70 con 0x7f7fd806fbe0 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.020+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7ff0086980 con 0x7f7fe0005320 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.024+0000 7f7ff8c23640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7fd80678c0 0x7f7fd8069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4140be0 tx=0x7f7fe4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.024+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7f7fd806fbe0 0x7f7fd8072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.024+0000 7f7ff9c25640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7f7fd806fbe0 0x7f7fd8072060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.024+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== osd.4 v2:172.21.15.47:6809/1602313510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ff0015e70 con 0x7f7fd806fbe0 2024-05-12T22:57:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.036+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 --> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ff4068330 con 0x7f7fd806fbe0 2024-05-12T22:57:02.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.036+0000 7f7fe9ffb640 1 -- 172.21.15.40:0/3944639463 <== osd.4 v2:172.21.15.47:6809/1602313510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ff4068330 con 0x7f7fd806fbe0 2024-05-12T22:57:02.041 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:02.041 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7f7fd806fbe0 msgr2=0x7f7fd8072060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.47:6809/1602313510,v1:172.21.15.47:6811/1602313510] conn(0x7f7fd806fbe0 0x7f7fd8072060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7fd80678c0 msgr2=0x7f7fd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7fd80678c0 0x7f7fd8069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4140be0 tx=0x7f7fe4008040 comp rx=0 tx=0).stop 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 msgr2=0x7f7ff40ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 --2- 172.21.15.40:0/3944639463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe0005320 0x7f7ff40ab670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000e7b0 tx=0x7f7ff000ec70 comp rx=0 tx=0).stop 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ff9c25640 1 -- 172.21.15.40:0/3944639463 reap_dead start 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 shutdown_connections 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 >> 172.21.15.40:0/3944639463 conn(0x7f7ff406b6c0 msgr2=0x7f7ff40b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 shutdown_connections 2024-05-12T22:57:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.040+0000 7f7ffb688640 1 -- 172.21.15.40:0/3944639463 wait complete. 2024-05-12T22:57:02.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-12T22:57:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 Processor -- start 2024-05-12T22:57:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 -- start start 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f54c00b5d70 0x7f54c0148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54c0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c00b6150 con 0x7f54c00b2c50 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f54c006f990 con 0x7f54c00b5d70 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54c57c2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f54c00708b0 con 0x7f54c013f760 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54be7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f54c00b2c50 0x7f54c013f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36930/0 (socket says 172.21.15.40:36930) 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54be7fc640 1 -- 172.21.15.40:0/679008404 learned_addr learned my addr 172.21.15.40:0/679008404 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54c0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54beffd640 1 --2- 172.21.15.40:0/679008404 >> v2:172.21.15.47:3300/0 conn(0x7f54c00b5d70 0x7f54c0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1040779295 0 0) 0x7f54c00b6150 con 0x7f54c00b2c50 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54a8003530 con 0x7f54c00b2c50 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374531371 0 0) 0x7f54a8003530 con 0x7f54c00b2c50 2024-05-12T22:57:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 msgr2=0x7f54c0148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54c0148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.164+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 >> v2:172.21.15.47:3300/0 conn(0x7f54c00b5d70 msgr2=0x7f54c0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 --2- 172.21.15.40:0/679008404 >> v2:172.21.15.47:3300/0 conn(0x7f54c00b5d70 0x7f54c0148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c006f620 con 0x7f54c00b2c50 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f54b0001680 con 0x7f54c00b2c50 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 >> v1:172.21.15.40:6789/0 conn(0x7f54c00b2c50 legacy=0x7f54c013f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54a80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54a8003f70 0x7f54a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a8004d50 0x7f54a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00708b0 con 0x7f54a8004d50 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54a800b9d0 con 0x7f54a8003f70 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f54a800bbd0 con 0x7f54c013f760 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a8004d50 0x7f54a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54be7fc640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54a8003f70 0x7f54a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54beffd640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54a80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 -- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 msgr2=0x7f54a80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c013f760 0x7f54a80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 -- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54a8003f70 msgr2=0x7f54a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54a8003f70 0x7f54a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 -- 172.21.15.40:0/679008404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a8003530 con 0x7f54a8004d50 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a8004d50 0x7f54a80051d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fc0 tx=0x7f54b801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f6675dba205af9 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b2070 con 0x7f54a8004d50 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b80a5b80 con 0x7f54a8004d50 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.168+0000 7f54bdffb640 1 -- 172.21.15.40:0/679008404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8009c10 con 0x7f54a8004d50 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/679008404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a8004d50 msgr2=0x7f54a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 --2- 172.21.15.40:0/679008404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54a8004d50 0x7f54a80051d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fc0 tx=0x7f54b801cc80 comp rx=0 tx=0).stop 2024-05-12T22:57:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54bf7fe640 1 -- 172.21.15.40:0/679008404 reap_dead start 2024-05-12T22:57:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/679008404 shutdown_connections 2024-05-12T22:57:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/679008404 >> 172.21.15.40:0/679008404 conn(0x7f54c006b6c0 msgr2=0x7f54c006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/679008404 shutdown_connections 2024-05-12T22:57:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/679008404 wait complete. 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 Processor -- start 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- start start 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 0x7f54c01407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54c01de970 0x7f54c013ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00b52e0 con 0x7f54c01ddfb0 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00b5160 con 0x7f54c01de970 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f54c0148ea0 con 0x7f54c0072580 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45318/0 (socket says 172.21.15.40:45318) 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 -- 172.21.15.40:0/2934202789 learned_addr learned my addr 172.21.15.40:0/2934202789 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54beffd640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 0x7f54c01407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54bf7fe640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54c01de970 0x7f54c013ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 -- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 msgr2=0x7f54c01407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 0x7f54c01407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 -- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54c01de970 msgr2=0x7f54c013ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54c01de970 0x7f54c013ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 -- 172.21.15.40:0/2934202789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c01dedf0 con 0x7f54c01ddfb0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54beffd640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 0x7f54c01407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54be7fc640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54b00119b0 tx=0x7f54b0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0010040 con 0x7f54c01ddfb0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b001a070 con 0x7f54c01ddfb0 2024-05-12T22:57:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c0072960 con 0x7f54c01ddfb0 2024-05-12T22:57:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b000fd20 con 0x7f54c01ddfb0 2024-05-12T22:57:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01429c0 con 0x7f54c01ddfb0 2024-05-12T22:57:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.172+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c0068330 con 0x7f54c01ddfb0 2024-05-12T22:57:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.176+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54b001f460 con 0x7f54c01ddfb0 2024-05-12T22:57:02.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.176+0000 7f54a77fe640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.176+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f54b0088f30 con 0x7f54c01ddfb0 2024-05-12T22:57:02.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.176+0000 7f54beffd640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.176+0000 7f54beffd640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 0x7f54ac069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009aa0 tx=0x7f54b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.180+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f54b0059a80 con 0x7f54c01ddfb0 2024-05-12T22:57:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f54c0141ee0 con 0x7f54ac0678c0 2024-05-12T22:57:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54a77fe640 1 -- 172.21.15.40:0/2934202789 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54c0141ee0 con 0x7f54ac0678c0 2024-05-12T22:57:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 msgr2=0x7f54ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 0x7f54ac069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009aa0 tx=0x7f54b4008040 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 msgr2=0x7f54c01de430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54b00119b0 tx=0x7f54b0011e70 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 shutdown_connections 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54c01de970 0x7f54c013ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54c01ddfb0 0x7f54c01de430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 --2- 172.21.15.40:0/2934202789 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f54c0072580 0x7f54c01407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 >> 172.21.15.40:0/2934202789 conn(0x7f54c006b6c0 msgr2=0x7f54c01431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 shutdown_connections 2024-05-12T22:57:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.344+0000 7f54c57c2640 1 -- 172.21.15.40:0/2934202789 wait complete. 2024-05-12T22:57:02.365 INFO:tasks.ceph:Scrubbing osd.5 2024-05-12T22:57:02.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 Processor -- start 2024-05-12T22:57:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 -- start start 2024-05-12T22:57:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95840afa80 0x7f9584147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95840b2dc0 con 0x7f95840b0110 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95840b0560 con 0x7f9584147260 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958c530640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f95840b1640 con 0x7f95840afa80 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958aacd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95840b0110 0x7f958414e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36940/0 (socket says 172.21.15.40:36940) 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.476+0000 7f958aacd640 1 -- 172.21.15.40:0/1839697249 learned_addr learned my addr 172.21.15.40:0/1839697249 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f9589acb640 1 --2- 172.21.15.40:0/1839697249 >> v2:172.21.15.47:3300/0 conn(0x7f95840afa80 0x7f9584147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831165266 0 0) 0x7f95840b2dc0 con 0x7f95840b0110 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9570005740 con 0x7f95840b0110 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 894499889 0 0) 0x7f9570005740 con 0x7f95840b0110 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 >> v2:172.21.15.47:3300/0 conn(0x7f95840afa80 msgr2=0x7f9584147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 --2- 172.21.15.40:0/1839697249 >> v2:172.21.15.47:3300/0 conn(0x7f95840afa80 0x7f9584147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 >> v1:172.21.15.47:6789/0 conn(0x7f9584147260 legacy=0x7f9584142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840b19a0 con 0x7f95840b0110 2024-05-12T22:57:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f9580001680 con 0x7f95840b0110 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 >> v1:172.21.15.40:6789/0 conn(0x7f95840b0110 legacy=0x7f958414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9570005bd0 0x7f9570005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9570006a20 0x7f9570006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 0x7f957000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95840b1640 con 0x7f95700073e0 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f957000e380 con 0x7f9570005bd0 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f957000e580 con 0x7f9570006a20 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 0x7f957000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958a2cc640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9570005bd0 0x7f9570005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 -- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9570006a20 msgr2=0x7f9570006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9570006a20 0x7f9570006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 -- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9570005bd0 msgr2=0x7f9570005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9570005bd0 0x7f9570005ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 -- 172.21.15.40:0/1839697249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570005740 con 0x7f95700073e0 2024-05-12T22:57:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 -- 172.21.15.40:0/1839697249 reap_dead start 2024-05-12T22:57:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958aacd640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 0x7f957000dbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f958000c1c0 tx=0x7f958001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60955206d424b4b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580007d00 con 0x7f95700073e0 2024-05-12T22:57:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580005b00 con 0x7f95700073e0 2024-05-12T22:57:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f95892ca640 1 -- 172.21.15.40:0/1839697249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580007070 con 0x7f95700073e0 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 -- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 msgr2=0x7f957000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 0x7f957000dbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f958000c1c0 tx=0x7f958001f3d0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 -- 172.21.15.40:0/1839697249 shutdown_connections 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 --2- 172.21.15.40:0/1839697249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95700073e0 0x7f957000dbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 -- 172.21.15.40:0/1839697249 >> 172.21.15.40:0/1839697249 conn(0x7f958406b6c0 msgr2=0x7f958406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 -- 172.21.15.40:0/1839697249 shutdown_connections 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.480+0000 7f958c530640 1 -- 172.21.15.40:0/1839697249 wait complete. 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 Processor -- start 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- start start 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f95700073e0 0x7f9584145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95841458b0 0x7f95841e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 0x7f9584071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95840b1f60 con 0x7f95841e0800 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9584147640 con 0x7f95841458b0 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f95840b2f90 con 0x7f95700073e0 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 0x7f9584071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 0x7f9584071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45342/0 (socket says 172.21.15.40:45342) 2024-05-12T22:57:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 -- 172.21.15.40:0/2059357624 learned_addr learned my addr 172.21.15.40:0/2059357624 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958a2cc640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f95700073e0 0x7f9584145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f9589acb640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95841458b0 0x7f95841e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 -- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f95700073e0 msgr2=0x7f9584145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f95700073e0 0x7f9584145370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 -- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95841458b0 msgr2=0x7f95841e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95841458b0 0x7f95841e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958413faa0 con 0x7f95841e0800 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958aacd640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 0x7f9584071b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f958000c2b0 tx=0x7f9570007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580001c40 con 0x7f95841e0800 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95800049f0 con 0x7f95841e0800 2024-05-12T22:57:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580004da0 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958413fd80 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9584144bf0 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95841e0cb0 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.484+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f95800070c0 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f95680678f0 0x7f9568069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9580122e20 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f958a2cc640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f95680678f0 0x7f9568069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f956806fc70 0x7f95680720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95800b3ec0 con 0x7f956806fc70 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9580125440 con 0x7f95841e0800 2024-05-12T22:57:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f958a2cc640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f95680678f0 0x7f9568069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f957c000f90 tx=0x7f957c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f9589acb640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f956806fc70 0x7f95680720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f9589acb640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f956806fc70 0x7f95680720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.488+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== osd.5 v2:172.21.15.47:6808/941811801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95800b3ec0 con 0x7f956806fc70 2024-05-12T22:57:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 --> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f95840722f0 con 0x7f956806fc70 2024-05-12T22:57:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f957affd640 1 -- 172.21.15.40:0/2059357624 <== osd.5 v2:172.21.15.47:6808/941811801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f95840722f0 con 0x7f956806fc70 2024-05-12T22:57:02.506 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:02.506 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:02.506 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f956806fc70 msgr2=0x7f95680720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.47:6808/941811801,v1:172.21.15.47:6810/941811801] conn(0x7f956806fc70 0x7f95680720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f95680678f0 msgr2=0x7f9568069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f95680678f0 0x7f9568069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f957c000f90 tx=0x7f957c009040 comp rx=0 tx=0).stop 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 msgr2=0x7f9584071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 --2- 172.21.15.40:0/2059357624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95841e0800 0x7f9584071b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f958000c2b0 tx=0x7f9570007a50 comp rx=0 tx=0).stop 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958aacd640 1 -- 172.21.15.40:0/2059357624 reap_dead start 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 shutdown_connections 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 >> 172.21.15.40:0/2059357624 conn(0x7f958406b6c0 msgr2=0x7f958406baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 shutdown_connections 2024-05-12T22:57:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.504+0000 7f958c530640 1 -- 172.21.15.40:0/2059357624 wait complete. 2024-05-12T22:57:02.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-12T22:57:02.534 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:02.566 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:02.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 Processor -- start 2024-05-12T22:57:02.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 -- start start 2024-05-12T22:57:02.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a3c067070 0x7f6a3c13f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6a3c073730 0x7f6a3c148860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c0b5450 con 0x7f6a3c067450 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c070450 con 0x7f6a3c067070 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a43c42640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c0b3880 con 0x7f6a3c073730 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a3c067070 0x7f6a3c13f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a3c067070 0x7f6a3c13f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45358/0 (socket says 172.21.15.40:45358) 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 -- 172.21.15.40:0/2211873044 learned_addr learned my addr 172.21.15.40:0/2211873044 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a411dd640 1 --2- 172.21.15.40:0/2211873044 >> v2:172.21.15.47:3300/0 conn(0x7f6a3c073730 0x7f6a3c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 -- 172.21.15.40:0/2211873044 >> v2:172.21.15.47:3300/0 conn(0x7f6a3c073730 msgr2=0x7f6a3c148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 --2- 172.21.15.40:0/2211873044 >> v2:172.21.15.47:3300/0 conn(0x7f6a3c073730 0x7f6a3c148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 -- 172.21.15.40:0/2211873044 >> v1:172.21.15.47:6789/0 conn(0x7f6a3c067450 legacy=0x7f6a3c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.628+0000 7f6a419de640 1 -- 172.21.15.40:0/2211873044 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c0b56f0 con 0x7f6a3c067070 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- 172.21.15.40:0/2211873044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c13f190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c149960 tx=0x7f6a3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489468ca6c873b15 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a409dc640 1 -- 172.21.15.40:0/2211873044 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380b1070 con 0x7f6a3c067070 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a409dc640 1 -- 172.21.15.40:0/2211873044 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a380ac600 con 0x7f6a3c067070 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a409dc640 1 -- 172.21.15.40:0/2211873044 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380ac9d0 con 0x7f6a3c067070 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/2211873044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 msgr2=0x7f6a3c13f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- 172.21.15.40:0/2211873044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c13f190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c149960 tx=0x7f6a3801c490 comp rx=0 tx=0).stop 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/2211873044 shutdown_connections 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- 172.21.15.40:0/2211873044 >> v2:172.21.15.47:3300/0 conn(0x7f6a3c073730 0x7f6a3c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- 172.21.15.40:0/2211873044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c13f190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/2211873044 >> 172.21.15.40:0/2211873044 conn(0x7f6a3c0b62d0 msgr2=0x7f6a3c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/2211873044 shutdown_connections 2024-05-12T22:57:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/2211873044 wait complete. 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 Processor -- start 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- start start 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a3c067450 0x7f6a3c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 0x7f6a3c1e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c152fa0 con 0x7f6a3c067070 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c152e20 con 0x7f6a3c073730 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c153120 con 0x7f6a3c067450 2024-05-12T22:57:02.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45368/0 (socket says 172.21.15.40:45368) 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 -- 172.21.15.40:0/3815845777 learned_addr learned my addr 172.21.15.40:0/3815845777 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a411dd640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a3c067450 0x7f6a3c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a421df640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 0x7f6a3c1e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 -- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a3c067450 msgr2=0x7f6a3c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a3c067450 0x7f6a3c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 -- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 msgr2=0x7f6a3c1e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 0x7f6a3c1e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 -- 172.21.15.40:0/3815845777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c13a070 con 0x7f6a3c067070 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a421df640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 0x7f6a3c1e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a419de640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a3801a0c0 tx=0x7f6a3801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380b1040 con 0x7f6a3c067070 2024-05-12T22:57:02.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a380bc070 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c141ce0 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380b78b0 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.632+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c1405e0 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c068a40 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a380ac4c0 con 0x7f6a3c067070 2024-05-12T22:57:02.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a327fc640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 0x7f6a20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6a3811fab0 con 0x7f6a3c067070 2024-05-12T22:57:02.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a411dd640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 0x7f6a20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.636+0000 7f6a411dd640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 0x7f6a20069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c13fd60 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.640+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6a380c5020 con 0x7f6a3c067070 2024-05-12T22:57:02.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.796+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6a3c148970 con 0x7f6a200678c0 2024-05-12T22:57:02.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.796+0000 7f6a327fc640 1 -- 172.21.15.40:0/3815845777 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a3c148970 con 0x7f6a200678c0 2024-05-12T22:57:02.801 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 msgr2=0x7f6a20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 0x7f6a20069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c13fd60 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 msgr2=0x7f6a3c1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a3801a0c0 tx=0x7f6a3801acd0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 shutdown_connections 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f6a200678c0 0x7f6a20069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a3c073730 0x7f6a3c1e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a3c067450 0x7f6a3c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 --2- 172.21.15.40:0/3815845777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a3c067070 0x7f6a3c1395f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 >> 172.21.15.40:0/3815845777 conn(0x7f6a3c0b62d0 msgr2=0x7f6a3c0b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 shutdown_connections 2024-05-12T22:57:02.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.800+0000 7f6a43c42640 1 -- 172.21.15.40:0/3815845777 wait complete. 2024-05-12T22:57:02.820 INFO:tasks.ceph:Scrubbing osd.6 2024-05-12T22:57:02.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:02.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 Processor -- start 2024-05-12T22:57:02.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 -- start start 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faed8072df0 0x7faed81477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed80b6150 con 0x7faed80b5d70 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7faed80b54d0 con 0x7faed8072df0 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedf18c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7faed80ae1f0 con 0x7faed80aecf0 2024-05-12T22:57:02.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faed8072df0 0x7faed81477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedcf28640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faed80b5d70 0x7faed80726e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36946/0 (socket says 172.21.15.40:36946) 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedcf28640 1 -- 172.21.15.40:0/317009061 learned_addr learned my addr 172.21.15.40:0/317009061 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed7fff640 1 -- 172.21.15.40:0/317009061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 msgr2=0x7faed8147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faedd729640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed7fff640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed8147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed7fff640 1 -- 172.21.15.40:0/317009061 >> v1:172.21.15.40:6789/0 conn(0x7faed80b5d70 legacy=0x7faed80726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed77fe640 1 -- 172.21.15.40:0/317009061 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656881681 0 0) 0x7faed80b6150 con 0x7faed80b5d70 2024-05-12T22:57:02.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.984+0000 7faed7fff640 1 -- 172.21.15.40:0/317009061 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed80b4e80 con 0x7faed8072df0 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faed7fff640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed8072df0 0x7faed81477b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faec00097c0 tx=0x7faec001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c62f7375951ce server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faed77fe640 1 -- 172.21.15.40:0/317009061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00ab430 con 0x7faed8072df0 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faed77fe640 1 -- 172.21.15.40:0/317009061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec00b0070 con 0x7faed8072df0 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faed77fe640 1 -- 172.21.15.40:0/317009061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00ab7f0 con 0x7faed8072df0 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- 172.21.15.40:0/317009061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed8072df0 msgr2=0x7faed81477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed8072df0 0x7faed81477b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faec00097c0 tx=0x7faec001c410 comp rx=0 tx=0).stop 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- 172.21.15.40:0/317009061 shutdown_connections 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed8147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- 172.21.15.40:0/317009061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed8072df0 0x7faed81477b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- 172.21.15.40:0/317009061 >> 172.21.15.40:0/317009061 conn(0x7faed806b6c0 msgr2=0x7faed806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:02.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- 172.21.15.40:0/317009061 shutdown_connections 2024-05-12T22:57:02.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- 172.21.15.40:0/317009061 wait complete. 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 Processor -- start 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- start start 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed8072df0 0x7faed8071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 0x7faed806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faed8154910 con 0x7faed80b5d70 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faed8154790 con 0x7faed8072df0 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedf18c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7faed8154a90 con 0x7faed80aecf0 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedd729640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 0x7faed806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedd729640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 0x7faed806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45390/0 (socket says 172.21.15.40:45390) 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedd729640 1 -- 172.21.15.40:0/439921726 learned_addr learned my addr 172.21.15.40:0/439921726 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.988+0000 7faedcf28640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed8072df0 0x7faed8071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed7fff640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 -- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 msgr2=0x7faed806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faed80aecf0 0x7faed806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 -- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed8072df0 msgr2=0x7faed8071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed8072df0 0x7faed8071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed8070f40 con 0x7faed80b5d70 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedcf28640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed8072df0 0x7faed8071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedd729640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 0x7faed806ff40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faec800c5e0 tx=0x7faec800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8015070 con 0x7faed80b5d70 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec8004220 con 0x7faed80b5d70 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed806f520 con 0x7faed80b5d70 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8003620 con 0x7faed80b5d70 2024-05-12T22:57:02.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed80711b0 con 0x7faed80b5d70 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faed8068330 con 0x7faed80b5d70 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faec80037c0 con 0x7faed80b5d70 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faeb80678c0 0x7faeb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedcf28640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faeb80678c0 0x7faeb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7faec8085ad0 con 0x7faed80b5d70 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7faeb806fc40 0x7faeb80720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faeb8072790 con 0x7faeb806fc40 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faec808a2c0 con 0x7faed80b5d70 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faedcf28640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faeb80678c0 0x7faeb8069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faed0007fd0 tx=0x7faed0005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed7fff640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7faeb806fc40 0x7faeb80720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:02.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.992+0000 7faed7fff640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7faeb806fc40 0x7faeb80720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:02.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:02.996+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== osd.6 v2:172.21.15.47:6800/2478742162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faeb8072790 con 0x7faeb806fc40 2024-05-12T22:57:03.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 --> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faed81470f0 con 0x7faeb806fc40 2024-05-12T22:57:03.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faed57fa640 1 -- 172.21.15.40:0/439921726 <== osd.6 v2:172.21.15.47:6800/2478742162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faed81470f0 con 0x7faeb806fc40 2024-05-12T22:57:03.012 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:03.012 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:03.012 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:03.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7faeb806fc40 msgr2=0x7faeb80720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.47:6800/2478742162,v1:172.21.15.47:6801/2478742162] conn(0x7faeb806fc40 0x7faeb80720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faeb80678c0 msgr2=0x7faeb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7faeb80678c0 0x7faeb8069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faed0007fd0 tx=0x7faed0005b80 comp rx=0 tx=0).stop 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 msgr2=0x7faed806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 --2- 172.21.15.40:0/439921726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faed80b5d70 0x7faed806ff40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faec800c5e0 tx=0x7faec800caa0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedd729640 1 -- 172.21.15.40:0/439921726 reap_dead start 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 shutdown_connections 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 >> 172.21.15.40:0/439921726 conn(0x7faed806b6c0 msgr2=0x7faed813d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 shutdown_connections 2024-05-12T22:57:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.008+0000 7faedf18c640 1 -- 172.21.15.40:0/439921726 wait complete. 2024-05-12T22:57:03.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-12T22:57:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 Processor -- start 2024-05-12T22:57:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 -- start start 2024-05-12T22:57:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3e81446a0 0x7fa3e8144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3e814fe40 0x7fa3e8152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e80aedf0 con 0x7fa3e8067330 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e8145090 con 0x7fa3e814fe40 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3ecd9d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e8067710 con 0x7fa3e81446a0 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e6d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3e814fe40 0x7fa3e8152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3e8067330 0x7fa3e80ae6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36960/0 (socket says 172.21.15.40:36960) 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e659c640 1 -- 172.21.15.40:0/1891812106 learned_addr learned my addr 172.21.15.40:0/1891812106 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e5d9b640 1 --2- 172.21.15.40:0/1891812106 >> v2:172.21.15.47:3300/0 conn(0x7fa3e81446a0 0x7fa3e8144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e6d9d640 1 -- 172.21.15.40:0/1891812106 >> v2:172.21.15.47:3300/0 conn(0x7fa3e81446a0 msgr2=0x7fa3e8144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e6d9d640 1 --2- 172.21.15.40:0/1891812106 >> v2:172.21.15.47:3300/0 conn(0x7fa3e81446a0 0x7fa3e8144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e6d9d640 1 -- 172.21.15.40:0/1891812106 >> v1:172.21.15.40:6789/0 conn(0x7fa3e8067330 legacy=0x7fa3e80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e6d9d640 1 -- 172.21.15.40:0/1891812106 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e80afef0 con 0x7fa3e814fe40 2024-05-12T22:57:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.140+0000 7fa3e559a640 1 -- 172.21.15.40:0/1891812106 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945568255 0 0) 0x7fa3e80aedf0 con 0x7fa3e8067330 2024-05-12T22:57:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e6d9d640 1 --2- 172.21.15.40:0/1891812106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e814fe40 0x7fa3e8152230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8074ee0 tx=0x7fa3d801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832dc95a5947941d server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e559a640 1 -- 172.21.15.40:0/1891812106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80b0070 con 0x7fa3e814fe40 2024-05-12T22:57:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e559a640 1 -- 172.21.15.40:0/1891812106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d80ab600 con 0x7fa3e814fe40 2024-05-12T22:57:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e559a640 1 -- 172.21.15.40:0/1891812106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80ab9d0 con 0x7fa3e814fe40 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1891812106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e814fe40 msgr2=0x7fa3e8152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1891812106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e814fe40 0x7fa3e8152230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8074ee0 tx=0x7fa3d801c3d0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1891812106 shutdown_connections 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1891812106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e814fe40 0x7fa3e8152230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1891812106 >> v2:172.21.15.47:3300/0 conn(0x7fa3e81446a0 0x7fa3e8144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1891812106 >> 172.21.15.40:0/1891812106 conn(0x7fa3e806b2c0 msgr2=0x7fa3e806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1891812106 shutdown_connections 2024-05-12T22:57:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1891812106 wait complete. 2024-05-12T22:57:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 Processor -- start 2024-05-12T22:57:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- start start 2024-05-12T22:57:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 0x7fa3e8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3e814fe40 0x7fa3e8151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e814ab20 con 0x7fa3e81446a0 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80ae1c0 con 0x7fa3e8067330 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3ecd9d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e80af7e0 con 0x7fa3e814fe40 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45408/0 (socket says 172.21.15.40:45408) 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e5d9b640 1 -- 172.21.15.40:0/1186515896 learned_addr learned my addr 172.21.15.40:0/1186515896 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e659c640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 0x7fa3e8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.144+0000 7fa3e6d9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3e814fe40 0x7fa3e8151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 -- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3e814fe40 msgr2=0x7fa3e8151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3e814fe40 0x7fa3e8151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 -- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 msgr2=0x7fa3e8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 0x7fa3e8148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 -- 172.21.15.40:0/1186515896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e8149ce0 con 0x7fa3e81446a0 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e659c640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 0x7fa3e8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e5d9b640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d830 tx=0x7fa3dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00b6c0 con 0x7fa3e81446a0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc019070 con 0x7fa3e81446a0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00ba60 con 0x7fa3e81446a0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e8152430 con 0x7fa3e81446a0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e814a6b0 con 0x7fa3e81446a0 2024-05-12T22:57:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e8068a40 con 0x7fa3e81446a0 2024-05-12T22:57:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3dc01e460 con 0x7fa3e81446a0 2024-05-12T22:57:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa3dc086520 con 0x7fa3e81446a0 2024-05-12T22:57:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e659c640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.148+0000 7fa3e659c640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 0x7fa3c8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005fd0 tx=0x7fa3e0005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.152+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa3dc056ec0 con 0x7fa3e81446a0 2024-05-12T22:57:03.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.328+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fa3e814a880 con 0x7fa3c80678c0 2024-05-12T22:57:03.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.328+0000 7fa3d6ffd640 1 -- 172.21.15.40:0/1186515896 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa3e814a880 con 0x7fa3c80678c0 2024-05-12T22:57:03.331 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 msgr2=0x7fa3c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 0x7fa3c8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005fd0 tx=0x7fa3e0005b80 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 msgr2=0x7fa3e81516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d830 tx=0x7fa3dc00dcf0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 shutdown_connections 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3e814fe40 0x7fa3e8151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e81446a0 0x7fa3e81516b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa3c80678c0 0x7fa3c8069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 --2- 172.21.15.40:0/1186515896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3e8067330 0x7fa3e8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 >> 172.21.15.40:0/1186515896 conn(0x7fa3e806b2c0 msgr2=0x7fa3e80b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 shutdown_connections 2024-05-12T22:57:03.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.332+0000 7fa3ecd9d640 1 -- 172.21.15.40:0/1186515896 wait complete. 2024-05-12T22:57:03.352 INFO:tasks.ceph:Scrubbing osd.7 2024-05-12T22:57:03.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-12T22:57:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 Processor -- start 2024-05-12T22:57:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 -- start start 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b4c0b59d0 0x7f9b4c148020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c141290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4c141c60 con 0x7f9b4c1417d0 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4c148560 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b51a88640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c0b5db0 con 0x7f9b4c0b77b0 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b4c0b59d0 0x7f9b4c148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b4c0b59d0 0x7f9b4c148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45412/0 (socket says 172.21.15.40:45412) 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 -- 172.21.15.40:0/464360790 learned_addr learned my addr 172.21.15.40:0/464360790 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4affd640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 -- 172.21.15.40:0/464360790 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 msgr2=0x7f9b4c141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c141290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 -- 172.21.15.40:0/464360790 >> v1:172.21.15.40:6789/0 conn(0x7f9b4c1417d0 legacy=0x7f9b4c14ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.468+0000 7f9b4b7fe640 1 -- 172.21.15.40:0/464360790 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c147560 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c148020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e50 tx=0x7f9b3c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355d53fd2ef5b9d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b4a7fc640 1 -- 172.21.15.40:0/464360790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a55e0 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b4a7fc640 1 -- 172.21.15.40:0/464360790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0a5780 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b4a7fc640 1 -- 172.21.15.40:0/464360790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a5b50 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- 172.21.15.40:0/464360790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c0b59d0 msgr2=0x7f9b4c148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c148020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e50 tx=0x7f9b3c01c910 comp rx=0 tx=0).stop 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- 172.21.15.40:0/464360790 shutdown_connections 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 --2- 172.21.15.40:0/464360790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c148020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- 172.21.15.40:0/464360790 >> 172.21.15.40:0/464360790 conn(0x7f9b4c0bce30 msgr2=0x7f9b4c0bd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- 172.21.15.40:0/464360790 shutdown_connections 2024-05-12T22:57:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- 172.21.15.40:0/464360790 wait complete. 2024-05-12T22:57:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 Processor -- start 2024-05-12T22:57:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.472+0000 7f9b51a88640 1 -- start start 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c1e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c1497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 0x7f9b4c149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0b96d0 con 0x7f9b4c1417d0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0b9550 con 0x7f9b4c0b59d0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c0b5080 con 0x7f9b4c0b77b0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 0x7f9b4c149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 0x7f9b4c149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45418/0 (socket says 172.21.15.40:45418) 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 -- 172.21.15.40:0/162938607 learned_addr learned my addr 172.21.15.40:0/162938607 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c1e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4affd640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c1497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 -- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 msgr2=0x7f9b4c1497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9b4c0b77b0 0x7f9b4c1497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 -- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0b59d0 msgr2=0x7f9b4c1e37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c1e37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1e3d00 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0b59d0 0x7f9b4c1e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4bfff640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 0x7f9b4c149cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c430 tx=0x7f9b4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44005220 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b440053c0 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c140980 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44007270 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c135720 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b4c068a40 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b44019020 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9b380678f0 0x7f9b38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9b440854f0 con 0x7f9b4c1417d0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9b380678f0 0x7f9b38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f9b3806fc70 0x7f9b380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b44006e50 con 0x7f9b3806fc70 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9b44085980 con 0x7f9b4c1417d0 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4b7fe640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9b380678f0 0x7f9b38069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0ae000 tx=0x7f9b3c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.476+0000 7f9b4affd640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f9b3806fc70 0x7f9b380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.480+0000 7f9b4affd640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f9b3806fc70 0x7f9b380720f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.480+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== osd.7 v2:172.21.15.47:6824/2871462616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b44006e50 con 0x7f9b3806fc70 2024-05-12T22:57:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.492+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 --> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b4c0b4980 con 0x7f9b3806fc70 2024-05-12T22:57:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b33fff640 1 -- 172.21.15.40:0/162938607 <== osd.7 v2:172.21.15.47:6824/2871462616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b4c0b4980 con 0x7f9b3806fc70 2024-05-12T22:57:03.497 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-05-12T22:57:03.498 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-12T22:57:03.498 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f9b3806fc70 msgr2=0x7f9b380720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.47:6824/2871462616,v1:172.21.15.47:6825/2871462616] conn(0x7f9b3806fc70 0x7f9b380720f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9b380678f0 msgr2=0x7f9b38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f9b380678f0 0x7f9b38069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0ae000 tx=0x7f9b3c0a7070 comp rx=0 tx=0).stop 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 msgr2=0x7f9b4c149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 --2- 172.21.15.40:0/162938607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c1417d0 0x7f9b4c149cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c430 tx=0x7f9b4400c8f0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b4bfff640 1 -- 172.21.15.40:0/162938607 reap_dead start 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 shutdown_connections 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 >> 172.21.15.40:0/162938607 conn(0x7f9b4c0bce30 msgr2=0x7f9b4c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 shutdown_connections 2024-05-12T22:57:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.496+0000 7f9b51a88640 1 -- 172.21.15.40:0/162938607 wait complete. 2024-05-12T22:57:03.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-12T22:57:03.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.628+0000 7fd0bea62640 1 Processor -- start 2024-05-12T22:57:03.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.628+0000 7fd0bea62640 1 -- start start 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b81418f0 0x7fd0b8152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b80bdbe0 con 0x7fd0b80bd800 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b80b6f40 con 0x7fd0b8147db0 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b80b56e0 con 0x7fd0b81418f0 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0b80bd800 0x7fd0b81476a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36984/0 (socket says 172.21.15.40:36984) 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b7fff640 1 -- 172.21.15.40:0/1405617739 learned_addr learned my addr 172.21.15.40:0/1405617739 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bcfff640 1 --2- 172.21.15.40:0/1405617739 >> v2:172.21.15.40:3300/0 conn(0x7fd0b81418f0 0x7fd0b8152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b6ffd640 1 -- 172.21.15.40:0/1405617739 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801449264 0 0) 0x7fd0b80bdbe0 con 0x7fd0b80bd800 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b6ffd640 1 -- 172.21.15.40:0/1405617739 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a0003530 con 0x7fd0b80bd800 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bcfff640 1 -- 172.21.15.40:0/1405617739 >> v1:172.21.15.47:6789/0 conn(0x7fd0b8147db0 legacy=0x7fd0b81411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bcfff640 1 -- 172.21.15.40:0/1405617739 >> v1:172.21.15.40:6789/0 conn(0x7fd0b80bd800 legacy=0x7fd0b81476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bcfff640 1 -- 172.21.15.40:0/1405617739 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b80b59c0 con 0x7fd0b81418f0 2024-05-12T22:57:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bcfff640 1 --2- 172.21.15.40:0/1405617739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81418f0 0x7fd0b8152df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a72501c840c174b server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b6ffd640 1 -- 172.21.15.40:0/1405617739 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a66e0 con 0x7fd0b81418f0 2024-05-12T22:57:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b6ffd640 1 -- 172.21.15.40:0/1405617739 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b00a6880 con 0x7fd0b81418f0 2024-05-12T22:57:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0b6ffd640 1 -- 172.21.15.40:0/1405617739 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a6c50 con 0x7fd0b81418f0 2024-05-12T22:57:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 -- 172.21.15.40:0/1405617739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81418f0 msgr2=0x7fd0b8152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.632+0000 7fd0bea62640 1 --2- 172.21.15.40:0/1405617739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81418f0 0x7fd0b8152df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b001c810 comp rx=0 tx=0).stop 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/1405617739 shutdown_connections 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 --2- 172.21.15.40:0/1405617739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81418f0 0x7fd0b8152df0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/1405617739 >> 172.21.15.40:0/1405617739 conn(0x7fd0b8072ff0 msgr2=0x7fd0b80bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/1405617739 shutdown_connections 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/1405617739 wait complete. 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 Processor -- start 2024-05-12T22:57:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- start start 2024-05-12T22:57:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0b81418f0 0x7fd0b8146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8147db0 0x7fd0b8136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8155cd0 con 0x7fd0b80bd800 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8155b50 con 0x7fd0b8147db0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b8155e50 con 0x7fd0b81418f0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45444/0 (socket says 172.21.15.40:45444) 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 -- 172.21.15.40:0/56945234 learned_addr learned my addr 172.21.15.40:0/56945234 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b77fe640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0b81418f0 0x7fd0b8146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bcfff640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8147db0 0x7fd0b8136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 -- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0b81418f0 msgr2=0x7fd0b8146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0b81418f0 0x7fd0b8146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 -- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8147db0 msgr2=0x7fd0b8136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8147db0 0x7fd0b8136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 -- 172.21.15.40:0/56945234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b8074a10 con 0x7fd0b80bd800 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b7fff640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c4d0 tx=0x7fd0a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8017070 con 0x7fd0b80bd800 2024-05-12T22:57:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a8005cf0 con 0x7fd0b80bd800 2024-05-12T22:57:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b8137140 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007270 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b8137e50 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.636+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b8068330 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.640+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0a801a070 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.640+0000 7fd0b4ff9640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 0x7fd0a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.640+0000 7fd0b77fe640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 0x7fd0a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.640+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd0a8085010 con 0x7fd0b80bd800 2024-05-12T22:57:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.640+0000 7fd0b77fe640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 0x7fd0a4069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0b81e11e0 tx=0x7fd0ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.644+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd0a8055480 con 0x7fd0b80bd800 2024-05-12T22:57:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.808+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fd0b8136a50 con 0x7fd0a40678c0 2024-05-12T22:57:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.808+0000 7fd0b4ff9640 1 -- 172.21.15.40:0/56945234 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd0b8136a50 con 0x7fd0a40678c0 2024-05-12T22:57:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 msgr2=0x7fd0a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 0x7fd0a4069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0b81e11e0 tx=0x7fd0ac009040 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 msgr2=0x7fd0b81e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c4d0 tx=0x7fd0a800c990 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 shutdown_connections 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fd0a40678c0 0x7fd0a4069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8147db0 0x7fd0b8136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0b81418f0 0x7fd0b8146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 --2- 172.21.15.40:0/56945234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b80bd800 0x7fd0b81e3620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 >> 172.21.15.40:0/56945234 conn(0x7fd0b8072ff0 msgr2=0x7fd0b8074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 shutdown_connections 2024-05-12T22:57:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.812+0000 7fd0bea62640 1 -- 172.21.15.40:0/56945234 wait complete. 2024-05-12T22:57:03.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:57:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 Processor -- start 2024-05-12T22:57:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 -- start start 2024-05-12T22:57:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f800b5ee0 0x7f7f80144100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f801477b0 0x7f7f80147c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f80144640 con 0x7f7f80071f40 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7f80148150 con 0x7f7f801477b0 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f8618c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7f800b62c0 con 0x7f7f800b5ee0 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f801477b0 0x7f7f80147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f801477b0 0x7f7f80147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45456/0 (socket says 172.21.15.40:45456) 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 -- 172.21.15.40:0/3322882843 learned_addr learned my addr 172.21.15.40:0/3322882843 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7f7fe640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f800b5ee0 0x7f7f80144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 -- 172.21.15.40:0/3322882843 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f800b5ee0 msgr2=0x7f7f80144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f800b5ee0 0x7f7f80144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 -- 172.21.15.40:0/3322882843 >> v1:172.21.15.47:6789/0 conn(0x7f7f80071f40 legacy=0x7f7f800b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.948+0000 7f7f7effd640 1 -- 172.21.15.40:0/3322882843 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f80072cf0 con 0x7f7f801477b0 2024-05-12T22:57:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7effd640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f801477b0 0x7f7f80147c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009870 tx=0x7f7f7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89349c1c951a0e05 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7e7fc640 1 -- 172.21.15.40:0/3322882843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b0070 con 0x7f7f801477b0 2024-05-12T22:57:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7e7fc640 1 -- 172.21.15.40:0/3322882843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700ab600 con 0x7f7f801477b0 2024-05-12T22:57:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7e7fc640 1 -- 172.21.15.40:0/3322882843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700ab9d0 con 0x7f7f801477b0 2024-05-12T22:57:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- 172.21.15.40:0/3322882843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f801477b0 msgr2=0x7f7f80147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f801477b0 0x7f7f80147c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009870 tx=0x7f7f7001c4d0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- 172.21.15.40:0/3322882843 shutdown_connections 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f801477b0 0x7f7f80147c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- 172.21.15.40:0/3322882843 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f800b5ee0 0x7f7f80144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- 172.21.15.40:0/3322882843 >> 172.21.15.40:0/3322882843 conn(0x7f7f8006b6c0 msgr2=0x7f7f8006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- 172.21.15.40:0/3322882843 shutdown_connections 2024-05-12T22:57:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- 172.21.15.40:0/3322882843 wait complete. 2024-05-12T22:57:03.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 Processor -- start 2024-05-12T22:57:03.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- start start 2024-05-12T22:57:03.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 0x7f7f8012c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f801477b0 0x7f7f8012b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80072900 con 0x7f7f800b5ee0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80072780 con 0x7f7f801477b0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f8618c640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8014fa50 con 0x7f7f80071f40 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.952+0000 7f7f7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45466/0 (socket says 172.21.15.40:45466) 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 -- 172.21.15.40:0/1903652121 learned_addr learned my addr 172.21.15.40:0/1903652121 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7f7fe640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 0x7f7f8012c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7ffff640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f801477b0 0x7f7f8012b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 -- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 msgr2=0x7f7f8012c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 0x7f7f8012c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 -- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f801477b0 msgr2=0x7f7f8012b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f801477b0 0x7f7f8012b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 -- 172.21.15.40:0/1903652121 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8012cdc0 con 0x7f7f800b5ee0 2024-05-12T22:57:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7f7fe640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 0x7f7f8012c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7effd640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ae040 tx=0x7f7f70019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b0040 con 0x7f7f800b5ee0 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700b4420 con 0x7f7f800b5ee0 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f80135790 con 0x7f7f800b5ee0 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b4810 con 0x7f7f800b5ee0 2024-05-12T22:57:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f80146a20 con 0x7f7f800b5ee0 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f80068330 con 0x7f7f800b5ee0 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f700b49b0 con 0x7f7f800b5ee0 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 0x7f7f6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7f7011f7f0 con 0x7f7f800b5ee0 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7f7fe640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 0x7f7f6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.956+0000 7f7f7f7fe640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 0x7f7f6c069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f74007a70 tx=0x7f7f74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:03.960+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7f8012cdc0 con 0x7f7f800b5ee0 2024-05-12T22:57:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.120+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f800679a0 con 0x7f7f6c0678c0 2024-05-12T22:57:04.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.132+0000 7f7f67fff640 1 -- 172.21.15.40:0/1903652121 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250742 (secure 0 0 0) 0x7f7f800679a0 con 0x7f7f6c0678c0 2024-05-12T22:57:04.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:57:04.139 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:57:04.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 msgr2=0x7f7f6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:04.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 0x7f7f6c069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f74007a70 tx=0x7f7f74008040 comp rx=0 tx=0).stop 2024-05-12T22:57:04.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 msgr2=0x7f7f801464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ae040 tx=0x7f7f70019270 comp rx=0 tx=0).stop 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 shutdown_connections 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7f6c0678c0 0x7f7f6c069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f801477b0 0x7f7f8012b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f800b5ee0 0x7f7f801464e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 --2- 172.21.15.40:0/1903652121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f80071f40 0x7f7f8012c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 >> 172.21.15.40:0/1903652121 conn(0x7f7f8006b6c0 msgr2=0x7f7f80137e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 shutdown_connections 2024-05-12T22:57:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:04.136+0000 7f7f8618c640 1 -- 172.21.15.40:0/1903652121 wait complete. 2024-05-12T22:57:04.156 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-05-12T22:57:03.428723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389671,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":344,"num_write_kb":3287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":871,"ondisk_log_size":871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239408,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754735312,"statfs":{"total":773094113280,"available":772848959488,"internally_reserved":0,"allocated":2539520,"data_stored":3457606,"data_compressed":296616,"data_compressed_allocated":368640,"data_compressed_original":2547712,"omap_allocated":12747,"internal_metadata":242535989},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7832,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003747"},"pg_stats":[{"pgid":"3.3f","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.177666+0000","last_change":"2024-05-12T22:52:35.588877+0000","last_active":"2024-05-12T22:56:51.177666+0000","last_peered":"2024-05-12T22:56:51.177666+0000","last_clean":"2024-05-12T22:56:51.177666+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:56:51.177666+0000","last_undegraded":"2024-05-12T22:56:51.177666+0000","last_fullsized":"2024-05-12T22:56:51.177666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:47:12.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.137898+0000","last_change":"2024-05-12T22:52:35.552764+0000","last_active":"2024-05-12T22:56:51.137898+0000","last_peered":"2024-05-12T22:56:51.137898+0000","last_clean":"2024-05-12T22:56:51.137898+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:56:51.137898+0000","last_undegraded":"2024-05-12T22:56:51.137898+0000","last_fullsized":"2024-05-12T22:56:51.137898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133733+0000","last_change":"2024-05-12T22:52:35.539795+0000","last_active":"2024-05-12T22:56:51.133733+0000","last_peered":"2024-05-12T22:56:51.133733+0000","last_clean":"2024-05-12T22:56:51.133733+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:56:51.133733+0000","last_undegraded":"2024-05-12T22:56:51.133733+0000","last_fullsized":"2024-05-12T22:56:51.133733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183765+0000","last_change":"2024-05-12T22:52:35.563960+0000","last_active":"2024-05-12T22:56:51.183765+0000","last_peered":"2024-05-12T22:56:51.183765+0000","last_clean":"2024-05-12T22:56:51.183765+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:56:51.183765+0000","last_undegraded":"2024-05-12T22:56:51.183765+0000","last_fullsized":"2024-05-12T22:56:51.183765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186544+0000","last_change":"2024-05-12T22:52:35.588327+0000","last_active":"2024-05-12T22:56:51.186544+0000","last_peered":"2024-05-12T22:56:51.186544+0000","last_clean":"2024-05-12T22:56:51.186544+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:56:51.186544+0000","last_undegraded":"2024-05-12T22:56:51.186544+0000","last_fullsized":"2024-05-12T22:56:51.186544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:07:59.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182874+0000","last_change":"2024-05-12T22:52:35.572074+0000","last_active":"2024-05-12T22:56:51.182874+0000","last_peered":"2024-05-12T22:56:51.182874+0000","last_clean":"2024-05-12T22:56:51.182874+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:56:51.182874+0000","last_undegraded":"2024-05-12T22:56:51.182874+0000","last_fullsized":"2024-05-12T22:56:51.182874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.166324+0000","last_change":"2024-05-12T22:52:35.586924+0000","last_active":"2024-05-12T22:56:51.166324+0000","last_peered":"2024-05-12T22:56:51.166324+0000","last_clean":"2024-05-12T22:56:51.166324+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:56:51.166324+0000","last_undegraded":"2024-05-12T22:56:51.166324+0000","last_fullsized":"2024-05-12T22:56:51.166324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178881+0000","last_change":"2024-05-12T22:52:35.569969+0000","last_active":"2024-05-12T22:56:51.178881+0000","last_peered":"2024-05-12T22:56:51.178881+0000","last_clean":"2024-05-12T22:56:51.178881+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:56:51.178881+0000","last_undegraded":"2024-05-12T22:56:51.178881+0000","last_fullsized":"2024-05-12T22:56:51.178881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.180668+0000","last_change":"2024-05-12T22:52:35.588252+0000","last_active":"2024-05-12T22:56:51.180668+0000","last_peered":"2024-05-12T22:56:51.180668+0000","last_clean":"2024-05-12T22:56:51.180668+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:56:51.180668+0000","last_undegraded":"2024-05-12T22:56:51.180668+0000","last_fullsized":"2024-05-12T22:56:51.180668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:07:55.757803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'16","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188935+0000","last_change":"2024-05-12T22:52:35.569783+0000","last_active":"2024-05-12T22:56:51.188935+0000","last_peered":"2024-05-12T22:56:51.188935+0000","last_clean":"2024-05-12T22:56:51.188935+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:56:51.188935+0000","last_undegraded":"2024-05-12T22:56:51.188935+0000","last_fullsized":"2024-05-12T22:56:51.188935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'6","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.182310+0000","last_change":"2024-05-12T22:52:35.568739+0000","last_active":"2024-05-12T22:56:51.182310+0000","last_peered":"2024-05-12T22:56:51.182310+0000","last_clean":"2024-05-12T22:56:51.182310+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:56:51.182310+0000","last_undegraded":"2024-05-12T22:56:51.182310+0000","last_fullsized":"2024-05-12T22:56:51.182310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179252+0000","last_change":"2024-05-12T22:52:35.595979+0000","last_active":"2024-05-12T22:56:51.179252+0000","last_peered":"2024-05-12T22:56:51.179252+0000","last_clean":"2024-05-12T22:56:51.179252+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:56:51.179252+0000","last_undegraded":"2024-05-12T22:56:51.179252+0000","last_fullsized":"2024-05-12T22:56:51.179252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173134+0000","last_change":"2024-05-12T22:52:35.550612+0000","last_active":"2024-05-12T22:56:51.173134+0000","last_peered":"2024-05-12T22:56:51.173134+0000","last_clean":"2024-05-12T22:56:51.173134+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:56:51.173134+0000","last_undegraded":"2024-05-12T22:56:51.173134+0000","last_fullsized":"2024-05-12T22:56:51.173134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.133611+0000","last_change":"2024-05-12T22:52:35.551224+0000","last_active":"2024-05-12T22:56:51.133611+0000","last_peered":"2024-05-12T22:56:51.133611+0000","last_clean":"2024-05-12T22:56:51.133611+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:56:51.133611+0000","last_undegraded":"2024-05-12T22:56:51.133611+0000","last_fullsized":"2024-05-12T22:56:51.133611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.171685+0000","last_change":"2024-05-12T22:52:35.585638+0000","last_active":"2024-05-12T22:56:51.171685+0000","last_peered":"2024-05-12T22:56:51.171685+0000","last_clean":"2024-05-12T22:56:51.171685+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:56:51.171685+0000","last_undegraded":"2024-05-12T22:56:51.171685+0000","last_fullsized":"2024-05-12T22:56:51.171685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'11","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.128525+0000","last_change":"2024-05-12T22:53:16.797441+0000","last_active":"2024-05-12T22:56:51.128525+0000","last_peered":"2024-05-12T22:56:51.128525+0000","last_clean":"2024-05-12T22:56:51.128525+0000","last_became_active":"2024-05-12T22:53:16.796573+0000","last_became_peered":"2024-05-12T22:53:16.796573+0000","last_unstale":"2024-05-12T22:56:51.128525+0000","last_undegraded":"2024-05-12T22:56:51.128525+0000","last_fullsized":"2024-05-12T22:56:51.128525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.179157+0000","last_change":"2024-05-12T22:52:35.574589+0000","last_active":"2024-05-12T22:56:51.179157+0000","last_peered":"2024-05-12T22:56:51.179157+0000","last_clean":"2024-05-12T22:56:51.179157+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:56:51.179157+0000","last_undegraded":"2024-05-12T22:56:51.179157+0000","last_fullsized":"2024-05-12T22:56:51.179157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172543+0000","last_change":"2024-05-12T22:52:35.564782+0000","last_active":"2024-05-12T22:56:51.172543+0000","last_peered":"2024-05-12T22:56:51.172543+0000","last_clean":"2024-05-12T22:56:51.172543+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:56:51.172543+0000","last_undegraded":"2024-05-12T22:56:51.172543+0000","last_fullsized":"2024-05-12T22:56:51.172543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.168264+0000","last_change":"2024-05-12T22:52:35.588218+0000","last_active":"2024-05-12T22:56:51.168264+0000","last_peered":"2024-05-12T22:56:51.168264+0000","last_clean":"2024-05-12T22:56:51.168264+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:56:51.168264+0000","last_undegraded":"2024-05-12T22:56:51.168264+0000","last_fullsized":"2024-05-12T22:56:51.168264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:35:56.982885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184335+0000","last_change":"2024-05-12T22:52:35.598820+0000","last_active":"2024-05-12T22:56:51.184335+0000","last_peered":"2024-05-12T22:56:51.184335+0000","last_clean":"2024-05-12T22:56:51.184335+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:56:51.184335+0000","last_undegraded":"2024-05-12T22:56:51.184335+0000","last_fullsized":"2024-05-12T22:56:51.184335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'11","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.189745+0000","last_change":"2024-05-12T22:52:35.586415+0000","last_active":"2024-05-12T22:56:51.189745+0000","last_peered":"2024-05-12T22:56:51.189745+0000","last_clean":"2024-05-12T22:56:51.189745+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:56:51.189745+0000","last_undegraded":"2024-05-12T22:56:51.189745+0000","last_fullsized":"2024-05-12T22:56:51.189745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186658+0000","last_change":"2024-05-12T22:52:35.579914+0000","last_active":"2024-05-12T22:56:51.186658+0000","last_peered":"2024-05-12T22:56:51.186658+0000","last_clean":"2024-05-12T22:56:51.186658+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:56:51.186658+0000","last_undegraded":"2024-05-12T22:56:51.186658+0000","last_fullsized":"2024-05-12T22:56:51.186658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146422+0000","last_change":"2024-05-12T22:52:35.585495+0000","last_active":"2024-05-12T22:56:51.146422+0000","last_peered":"2024-05-12T22:56:51.146422+0000","last_clean":"2024-05-12T22:56:51.146422+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:56:51.146422+0000","last_undegraded":"2024-05-12T22:56:51.146422+0000","last_fullsized":"2024-05-12T22:56:51.146422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181469+0000","last_change":"2024-05-12T22:52:35.549477+0000","last_active":"2024-05-12T22:56:51.181469+0000","last_peered":"2024-05-12T22:56:51.181469+0000","last_clean":"2024-05-12T22:56:51.181469+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:56:51.181469+0000","last_undegraded":"2024-05-12T22:56:51.181469+0000","last_fullsized":"2024-05-12T22:56:51.181469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.151233+0000","last_change":"2024-05-12T22:52:35.577590+0000","last_active":"2024-05-12T22:56:51.151233+0000","last_peered":"2024-05-12T22:56:51.151233+0000","last_clean":"2024-05-12T22:56:51.151233+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:56:51.151233+0000","last_undegraded":"2024-05-12T22:56:51.151233+0000","last_fullsized":"2024-05-12T22:56:51.151233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'13","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188917+0000","last_change":"2024-05-12T22:52:35.587800+0000","last_active":"2024-05-12T22:56:51.188917+0000","last_peered":"2024-05-12T22:56:51.188917+0000","last_clean":"2024-05-12T22:56:51.188917+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:56:51.188917+0000","last_undegraded":"2024-05-12T22:56:51.188917+0000","last_fullsized":"2024-05-12T22:56:51.188917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'6","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:56.400591+0000","last_change":"2024-05-12T22:53:16.705033+0000","last_active":"2024-05-12T22:56:56.400591+0000","last_peered":"2024-05-12T22:56:56.400591+0000","last_clean":"2024-05-12T22:56:56.400591+0000","last_became_active":"2024-05-12T22:53:16.704085+0000","last_became_peered":"2024-05-12T22:53:16.704085+0000","last_unstale":"2024-05-12T22:56:56.400591+0000","last_undegraded":"2024-05-12T22:56:56.400591+0000","last_fullsized":"2024-05-12T22:56:56.400591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.175677+0000","last_change":"2024-05-12T22:52:35.591325+0000","last_active":"2024-05-12T22:56:51.175677+0000","last_peered":"2024-05-12T22:56:51.175677+0000","last_clean":"2024-05-12T22:56:51.175677+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:56:51.175677+0000","last_undegraded":"2024-05-12T22:56:51.175677+0000","last_fullsized":"2024-05-12T22:56:51.175677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:11:20.136362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.131710+0000","last_change":"2024-05-12T22:52:35.546418+0000","last_active":"2024-05-12T22:56:51.131710+0000","last_peered":"2024-05-12T22:56:51.131710+0000","last_clean":"2024-05-12T22:56:51.131710+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:56:51.131710+0000","last_undegraded":"2024-05-12T22:56:51.131710+0000","last_fullsized":"2024-05-12T22:56:51.131710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183211+0000","last_change":"2024-05-12T22:52:35.565041+0000","last_active":"2024-05-12T22:56:51.183211+0000","last_peered":"2024-05-12T22:56:51.183211+0000","last_clean":"2024-05-12T22:56:51.183211+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:56:51.183211+0000","last_undegraded":"2024-05-12T22:56:51.183211+0000","last_fullsized":"2024-05-12T22:56:51.183211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.130858+0000","last_change":"2024-05-12T22:52:35.568052+0000","last_active":"2024-05-12T22:56:51.130858+0000","last_peered":"2024-05-12T22:56:51.130858+0000","last_clean":"2024-05-12T22:56:51.130858+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:56:51.130858+0000","last_undegraded":"2024-05-12T22:56:51.130858+0000","last_fullsized":"2024-05-12T22:56:51.130858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.162196+0000","last_change":"2024-05-12T22:52:35.552480+0000","last_active":"2024-05-12T22:56:51.162196+0000","last_peered":"2024-05-12T22:56:51.162196+0000","last_clean":"2024-05-12T22:56:51.162196+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:56:51.162196+0000","last_undegraded":"2024-05-12T22:56:51.162196+0000","last_fullsized":"2024-05-12T22:56:51.162196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:34:40.585799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.149317+0000","last_change":"2024-05-12T22:52:35.590958+0000","last_active":"2024-05-12T22:56:51.149317+0000","last_peered":"2024-05-12T22:56:51.149317+0000","last_clean":"2024-05-12T22:56:51.149317+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:56:51.149317+0000","last_undegraded":"2024-05-12T22:56:51.149317+0000","last_fullsized":"2024-05-12T22:56:51.149317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.628217+0000","last_change":"2024-05-12T22:52:34.561460+0000","last_active":"2024-05-12T22:54:20.628217+0000","last_peered":"2024-05-12T22:54:20.628217+0000","last_clean":"2024-05-12T22:54:20.628217+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:54:20.628217+0000","last_undegraded":"2024-05-12T22:54:20.628217+0000","last_fullsized":"2024-05-12T22:54:20.628217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.142357+0000","last_change":"2024-05-12T22:52:35.578902+0000","last_active":"2024-05-12T22:56:51.142357+0000","last_peered":"2024-05-12T22:56:51.142357+0000","last_clean":"2024-05-12T22:56:51.142357+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:56:51.142357+0000","last_undegraded":"2024-05-12T22:56:51.142357+0000","last_fullsized":"2024-05-12T22:56:51.142357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.632005+0000","last_change":"2024-05-12T22:52:34.569173+0000","last_active":"2024-05-12T22:54:20.632005+0000","last_peered":"2024-05-12T22:54:20.632005+0000","last_clean":"2024-05-12T22:54:20.632005+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:54:20.632005+0000","last_undegraded":"2024-05-12T22:54:20.632005+0000","last_fullsized":"2024-05-12T22:54:20.632005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.636641+0000","last_change":"2024-05-12T22:52:34.569942+0000","last_active":"2024-05-12T22:54:23.636641+0000","last_peered":"2024-05-12T22:54:23.636641+0000","last_clean":"2024-05-12T22:54:23.636641+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:54:23.636641+0000","last_undegraded":"2024-05-12T22:54:23.636641+0000","last_fullsized":"2024-05-12T22:54:23.636641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134633+0000","last_change":"2024-05-12T22:52:35.547176+0000","last_active":"2024-05-12T22:56:51.134633+0000","last_peered":"2024-05-12T22:56:51.134633+0000","last_clean":"2024-05-12T22:56:51.134633+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:56:51.134633+0000","last_undegraded":"2024-05-12T22:56:51.134633+0000","last_fullsized":"2024-05-12T22:56:51.134633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.633590+0000","last_change":"2024-05-12T22:52:34.567147+0000","last_active":"2024-05-12T22:54:23.633590+0000","last_peered":"2024-05-12T22:54:23.633590+0000","last_clean":"2024-05-12T22:54:23.633590+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:54:23.633590+0000","last_undegraded":"2024-05-12T22:54:23.633590+0000","last_fullsized":"2024-05-12T22:54:23.633590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'11","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.138001+0000","last_change":"2024-05-12T22:52:35.548888+0000","last_active":"2024-05-12T22:56:51.138001+0000","last_peered":"2024-05-12T22:56:51.138001+0000","last_clean":"2024-05-12T22:56:51.138001+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:56:51.138001+0000","last_undegraded":"2024-05-12T22:56:51.138001+0000","last_fullsized":"2024-05-12T22:56:51.138001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.631837+0000","last_change":"2024-05-12T22:52:34.568362+0000","last_active":"2024-05-12T22:54:23.631837+0000","last_peered":"2024-05-12T22:54:23.631837+0000","last_clean":"2024-05-12T22:54:23.631837+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:54:23.631837+0000","last_undegraded":"2024-05-12T22:54:23.631837+0000","last_fullsized":"2024-05-12T22:54:23.631837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169559+0000","last_change":"2024-05-12T22:53:16.797487+0000","last_active":"2024-05-12T22:56:51.169559+0000","last_peered":"2024-05-12T22:56:51.169559+0000","last_clean":"2024-05-12T22:56:51.169559+0000","last_became_active":"2024-05-12T22:53:16.796547+0000","last_became_peered":"2024-05-12T22:53:16.796547+0000","last_unstale":"2024-05-12T22:56:51.169559+0000","last_undegraded":"2024-05-12T22:56:51.169559+0000","last_fullsized":"2024-05-12T22:56:51.169559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"23'7","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.634995+0000","last_change":"2024-05-12T22:52:34.570719+0000","last_active":"2024-05-12T22:54:23.634995+0000","last_peered":"2024-05-12T22:54:23.634995+0000","last_clean":"2024-05-12T22:54:23.634995+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:54:23.634995+0000","last_undegraded":"2024-05-12T22:54:23.634995+0000","last_fullsized":"2024-05-12T22:54:23.634995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:52:15.570281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'9","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147178+0000","last_change":"2024-05-12T22:52:35.558715+0000","last_active":"2024-05-12T22:56:51.147178+0000","last_peered":"2024-05-12T22:56:51.147178+0000","last_clean":"2024-05-12T22:56:51.147178+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:56:51.147178+0000","last_undegraded":"2024-05-12T22:56:51.147178+0000","last_fullsized":"2024-05-12T22:56:51.147178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'15","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.741506+0000","last_change":"2024-05-12T22:52:34.564281+0000","last_active":"2024-05-12T22:56:50.741506+0000","last_peered":"2024-05-12T22:56:50.741506+0000","last_clean":"2024-05-12T22:56:50.741506+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:56:50.741506+0000","last_undegraded":"2024-05-12T22:56:50.741506+0000","last_fullsized":"2024-05-12T22:56:50.741506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.188757+0000","last_change":"2024-05-12T22:52:35.591869+0000","last_active":"2024-05-12T22:56:51.188757+0000","last_peered":"2024-05-12T22:56:51.188757+0000","last_clean":"2024-05-12T22:56:51.188757+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:56:51.188757+0000","last_undegraded":"2024-05-12T22:56:51.188757+0000","last_fullsized":"2024-05-12T22:56:51.188757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'50","reported_seq":68,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.192438+0000","last_change":"2024-05-12T22:52:34.569259+0000","last_active":"2024-05-12T22:56:51.192438+0000","last_peered":"2024-05-12T22:56:51.192438+0000","last_clean":"2024-05-12T22:56:51.192438+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:56:51.192438+0000","last_undegraded":"2024-05-12T22:56:51.192438+0000","last_fullsized":"2024-05-12T22:56:51.192438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":787597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.164394+0000","last_change":"2024-05-12T22:52:35.571523+0000","last_active":"2024-05-12T22:56:51.164394+0000","last_peered":"2024-05-12T22:56:51.164394+0000","last_clean":"2024-05-12T22:56:51.164394+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:56:51.164394+0000","last_undegraded":"2024-05-12T22:56:51.164394+0000","last_fullsized":"2024-05-12T22:56:51.164394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:56:43.209459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-12T22:57:01.422079+0000","last_change":"2024-05-12T22:57:01.421799+0000","last_active":"2024-05-12T22:57:01.422079+0000","last_peered":"2024-05-12T22:57:01.422079+0000","last_clean":"2024-05-12T22:57:01.422079+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:57:01.422079+0000","last_undegraded":"2024-05-12T22:57:01.422079+0000","last_fullsized":"2024-05-12T22:57:01.422079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.169214+0000","last_change":"2024-05-12T22:52:35.566133+0000","last_active":"2024-05-12T22:56:51.169214+0000","last_peered":"2024-05-12T22:56:51.169214+0000","last_clean":"2024-05-12T22:56:51.169214+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:56:51.169214+0000","last_undegraded":"2024-05-12T22:56:51.169214+0000","last_fullsized":"2024-05-12T22:56:51.169214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:24.626650+0000","last_change":"2024-05-12T22:52:34.544956+0000","last_active":"2024-05-12T22:54:24.626650+0000","last_peered":"2024-05-12T22:54:24.626650+0000","last_clean":"2024-05-12T22:54:24.626650+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:54:24.626650+0000","last_undegraded":"2024-05-12T22:54:24.626650+0000","last_fullsized":"2024-05-12T22:54:24.626650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'20","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186680+0000","last_change":"2024-05-12T22:52:35.591979+0000","last_active":"2024-05-12T22:56:51.186680+0000","last_peered":"2024-05-12T22:56:51.186680+0000","last_clean":"2024-05-12T22:56:51.186680+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:56:51.186680+0000","last_undegraded":"2024-05-12T22:56:51.186680+0000","last_fullsized":"2024-05-12T22:56:51.186680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632570+0000","last_change":"2024-05-12T22:52:34.563882+0000","last_active":"2024-05-12T22:54:23.632570+0000","last_peered":"2024-05-12T22:54:23.632570+0000","last_clean":"2024-05-12T22:54:23.632570+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:54:23.632570+0000","last_undegraded":"2024-05-12T22:54:23.632570+0000","last_fullsized":"2024-05-12T22:54:23.632570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:49:43.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.173281+0000","last_change":"2024-05-12T22:52:35.553042+0000","last_active":"2024-05-12T22:56:51.173281+0000","last_peered":"2024-05-12T22:56:51.173281+0000","last_clean":"2024-05-12T22:56:51.173281+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:56:51.173281+0000","last_undegraded":"2024-05-12T22:56:51.173281+0000","last_fullsized":"2024-05-12T22:56:51.173281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:26:18.565761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.738427+0000","last_change":"2024-05-12T22:52:34.551737+0000","last_active":"2024-05-12T22:56:50.738427+0000","last_peered":"2024-05-12T22:56:50.738427+0000","last_clean":"2024-05-12T22:56:50.738427+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:56:50.738427+0000","last_undegraded":"2024-05-12T22:56:50.738427+0000","last_fullsized":"2024-05-12T22:56:50.738427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176530+0000","last_change":"2024-05-12T22:52:35.592879+0000","last_active":"2024-05-12T22:56:51.176530+0000","last_peered":"2024-05-12T22:56:51.176530+0000","last_clean":"2024-05-12T22:56:51.176530+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:56:51.176530+0000","last_undegraded":"2024-05-12T22:56:51.176530+0000","last_fullsized":"2024-05-12T22:56:51.176530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:33:01.910796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:52.398739+0000","last_change":"2024-05-12T22:52:34.556336+0000","last_active":"2024-05-12T22:54:52.398739+0000","last_peered":"2024-05-12T22:54:52.398739+0000","last_clean":"2024-05-12T22:54:52.398739+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:54:52.398739+0000","last_undegraded":"2024-05-12T22:54:52.398739+0000","last_fullsized":"2024-05-12T22:54:52.398739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176193+0000","last_change":"2024-05-12T22:52:35.592037+0000","last_active":"2024-05-12T22:56:51.176193+0000","last_peered":"2024-05-12T22:56:51.176193+0000","last_clean":"2024-05-12T22:56:51.176193+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:56:51.176193+0000","last_undegraded":"2024-05-12T22:56:51.176193+0000","last_fullsized":"2024-05-12T22:56:51.176193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:51.396178+0000","last_change":"2024-05-12T22:52:34.550052+0000","last_active":"2024-05-12T22:54:51.396178+0000","last_peered":"2024-05-12T22:54:51.396178+0000","last_clean":"2024-05-12T22:54:51.396178+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:54:51.396178+0000","last_undegraded":"2024-05-12T22:54:51.396178+0000","last_fullsized":"2024-05-12T22:54:51.396178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.184494+0000","last_change":"2024-05-12T22:52:35.593023+0000","last_active":"2024-05-12T22:56:51.184494+0000","last_peered":"2024-05-12T22:56:51.184494+0000","last_clean":"2024-05-12T22:56:51.184494+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:56:51.184494+0000","last_undegraded":"2024-05-12T22:56:51.184494+0000","last_fullsized":"2024-05-12T22:56:51.184494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:35:39.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:51.384629+0000","last_change":"2024-05-12T22:52:34.557895+0000","last_active":"2024-05-12T22:54:51.384629+0000","last_peered":"2024-05-12T22:54:51.384629+0000","last_clean":"2024-05-12T22:54:51.384629+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:54:51.384629+0000","last_undegraded":"2024-05-12T22:54:51.384629+0000","last_fullsized":"2024-05-12T22:54:51.384629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183640+0000","last_change":"2024-05-12T22:52:35.557142+0000","last_active":"2024-05-12T22:56:51.183640+0000","last_peered":"2024-05-12T22:56:51.183640+0000","last_clean":"2024-05-12T22:56:51.183640+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:56:51.183640+0000","last_undegraded":"2024-05-12T22:56:51.183640+0000","last_fullsized":"2024-05-12T22:56:51.183640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:52:42.528821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:48.741994+0000","last_change":"2024-05-12T22:52:34.550371+0000","last_active":"2024-05-12T22:56:48.741994+0000","last_peered":"2024-05-12T22:56:48.741994+0000","last_clean":"2024-05-12T22:56:48.741994+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:56:48.741994+0000","last_undegraded":"2024-05-12T22:56:48.741994+0000","last_fullsized":"2024-05-12T22:56:48.741994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.183083+0000","last_change":"2024-05-12T22:52:35.573198+0000","last_active":"2024-05-12T22:56:51.183083+0000","last_peered":"2024-05-12T22:56:51.183083+0000","last_clean":"2024-05-12T22:56:51.183083+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:56:51.183083+0000","last_undegraded":"2024-05-12T22:56:51.183083+0000","last_fullsized":"2024-05-12T22:56:51.183083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:22.393910+0000","last_change":"2024-05-12T22:52:22.853971+0000","last_active":"2024-05-12T22:54:22.393910+0000","last_peered":"2024-05-12T22:54:22.393910+0000","last_clean":"2024-05-12T22:54:22.393910+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:54:22.393910+0000","last_undegraded":"2024-05-12T22:54:22.393910+0000","last_fullsized":"2024-05-12T22:54:22.393910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:21.468428+0000","last_clean_scrub_stamp":"2024-05-12T22:52:21.468428+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:46:11.282527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394617+0000","last_change":"2024-05-12T22:52:34.549560+0000","last_active":"2024-05-12T22:54:42.394617+0000","last_peered":"2024-05-12T22:54:42.394617+0000","last_clean":"2024-05-12T22:54:42.394617+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:54:42.394617+0000","last_undegraded":"2024-05-12T22:54:42.394617+0000","last_fullsized":"2024-05-12T22:54:42.394617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:22:43.917764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'8","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178597+0000","last_change":"2024-05-12T22:52:35.569733+0000","last_active":"2024-05-12T22:56:51.178597+0000","last_peered":"2024-05-12T22:56:51.178597+0000","last_clean":"2024-05-12T22:56:51.178597+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:56:51.178597+0000","last_undegraded":"2024-05-12T22:56:51.178597+0000","last_fullsized":"2024-05-12T22:56:51.178597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:12:45.200071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:37.396332+0000","last_change":"2024-05-12T22:52:34.576127+0000","last_active":"2024-05-12T22:54:37.396332+0000","last_peered":"2024-05-12T22:54:37.396332+0000","last_clean":"2024-05-12T22:54:37.396332+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:54:37.396332+0000","last_undegraded":"2024-05-12T22:54:37.396332+0000","last_fullsized":"2024-05-12T22:54:37.396332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.141948+0000","last_change":"2024-05-12T22:52:35.578755+0000","last_active":"2024-05-12T22:56:51.141948+0000","last_peered":"2024-05-12T22:56:51.141948+0000","last_clean":"2024-05-12T22:56:51.141948+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:56:51.141948+0000","last_undegraded":"2024-05-12T22:56:51.141948+0000","last_fullsized":"2024-05-12T22:56:51.141948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'20","reported_seq":55,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:50.736797+0000","last_change":"2024-05-12T22:52:34.551909+0000","last_active":"2024-05-12T22:56:50.736797+0000","last_peered":"2024-05-12T22:56:50.736797+0000","last_clean":"2024-05-12T22:56:50.736797+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:56:50.736797+0000","last_undegraded":"2024-05-12T22:56:50.736797+0000","last_fullsized":"2024-05-12T22:56:50.736797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10908,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":14,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.135260+0000","last_change":"2024-05-12T22:52:35.552933+0000","last_active":"2024-05-12T22:56:51.135260+0000","last_peered":"2024-05-12T22:56:51.135260+0000","last_clean":"2024-05-12T22:56:51.135260+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:56:51.135260+0000","last_undegraded":"2024-05-12T22:56:51.135260+0000","last_fullsized":"2024-05-12T22:56:51.135260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.394592+0000","last_change":"2024-05-12T22:52:34.561638+0000","last_active":"2024-05-12T22:54:42.394592+0000","last_peered":"2024-05-12T22:54:42.394592+0000","last_clean":"2024-05-12T22:54:42.394592+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:54:42.394592+0000","last_undegraded":"2024-05-12T22:54:42.394592+0000","last_fullsized":"2024-05-12T22:54:42.394592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'9","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.145987+0000","last_change":"2024-05-12T22:52:35.598743+0000","last_active":"2024-05-12T22:56:51.145987+0000","last_peered":"2024-05-12T22:56:51.145987+0000","last_clean":"2024-05-12T22:56:51.145987+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:56:51.145987+0000","last_undegraded":"2024-05-12T22:56:51.145987+0000","last_fullsized":"2024-05-12T22:56:51.145987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:46.398942+0000","last_change":"2024-05-12T22:52:34.554663+0000","last_active":"2024-05-12T22:56:46.398942+0000","last_peered":"2024-05-12T22:56:46.398942+0000","last_clean":"2024-05-12T22:56:46.398942+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:56:46.398942+0000","last_undegraded":"2024-05-12T22:56:46.398942+0000","last_fullsized":"2024-05-12T22:56:46.398942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.181791+0000","last_change":"2024-05-12T22:52:35.550761+0000","last_active":"2024-05-12T22:56:51.181791+0000","last_peered":"2024-05-12T22:56:51.181791+0000","last_clean":"2024-05-12T22:56:51.181791+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:56:51.181791+0000","last_undegraded":"2024-05-12T22:56:51.181791+0000","last_fullsized":"2024-05-12T22:56:51.181791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:42.397237+0000","last_change":"2024-05-12T22:52:34.579327+0000","last_active":"2024-05-12T22:54:42.397237+0000","last_peered":"2024-05-12T22:54:42.397237+0000","last_clean":"2024-05-12T22:54:42.397237+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:54:42.397237+0000","last_undegraded":"2024-05-12T22:54:42.397237+0000","last_fullsized":"2024-05-12T22:54:42.397237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:33:04.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'12","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.134777+0000","last_change":"2024-05-12T22:52:35.550943+0000","last_active":"2024-05-12T22:56:51.134777+0000","last_peered":"2024-05-12T22:56:51.134777+0000","last_clean":"2024-05-12T22:56:51.134777+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:56:51.134777+0000","last_undegraded":"2024-05-12T22:56:51.134777+0000","last_fullsized":"2024-05-12T22:56:51.134777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'42","reported_seq":63,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:56.400629+0000","last_change":"2024-05-12T22:52:34.570317+0000","last_active":"2024-05-12T22:56:56.400629+0000","last_peered":"2024-05-12T22:56:56.400629+0000","last_clean":"2024-05-12T22:56:56.400629+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:56:56.400629+0000","last_undegraded":"2024-05-12T22:56:56.400629+0000","last_fullsized":"2024-05-12T22:56:56.400629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.172431+0000","last_change":"2024-05-12T22:52:35.574118+0000","last_active":"2024-05-12T22:56:51.172431+0000","last_peered":"2024-05-12T22:56:51.172431+0000","last_clean":"2024-05-12T22:56:51.172431+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:56:51.172431+0000","last_undegraded":"2024-05-12T22:56:51.172431+0000","last_fullsized":"2024-05-12T22:56:51.172431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.401513+0000","last_change":"2024-05-12T22:52:34.580985+0000","last_active":"2024-05-12T22:54:47.401513+0000","last_peered":"2024-05-12T22:54:47.401513+0000","last_clean":"2024-05-12T22:54:47.401513+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:54:47.401513+0000","last_undegraded":"2024-05-12T22:54:47.401513+0000","last_fullsized":"2024-05-12T22:54:47.401513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:59:39.186719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:56.422969+0000","last_change":"2024-05-12T22:52:35.551264+0000","last_active":"2024-05-12T22:56:56.422969+0000","last_peered":"2024-05-12T22:56:56.422969+0000","last_clean":"2024-05-12T22:56:56.422969+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:56:56.422969+0000","last_undegraded":"2024-05-12T22:56:56.422969+0000","last_fullsized":"2024-05-12T22:56:56.422969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:47.398007+0000","last_change":"2024-05-12T22:52:34.572326+0000","last_active":"2024-05-12T22:54:47.398007+0000","last_peered":"2024-05-12T22:54:47.398007+0000","last_clean":"2024-05-12T22:54:47.398007+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:54:47.398007+0000","last_undegraded":"2024-05-12T22:54:47.398007+0000","last_fullsized":"2024-05-12T22:54:47.398007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:49:39.149847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:57.416716+0000","last_change":"2024-05-12T22:52:35.577929+0000","last_active":"2024-05-12T22:56:57.416716+0000","last_peered":"2024-05-12T22:56:57.416716+0000","last_clean":"2024-05-12T22:56:57.416716+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:56:57.416716+0000","last_undegraded":"2024-05-12T22:56:57.416716+0000","last_fullsized":"2024-05-12T22:56:57.416716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:56.400475+0000","last_change":"2024-05-12T22:52:34.563867+0000","last_active":"2024-05-12T22:56:56.400475+0000","last_peered":"2024-05-12T22:56:56.400475+0000","last_clean":"2024-05-12T22:56:56.400475+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:56:56.400475+0000","last_undegraded":"2024-05-12T22:56:56.400475+0000","last_fullsized":"2024-05-12T22:56:56.400475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'6","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136855+0000","last_change":"2024-05-12T22:52:35.554720+0000","last_active":"2024-05-12T22:56:51.136855+0000","last_peered":"2024-05-12T22:56:51.136855+0000","last_clean":"2024-05-12T22:56:51.136855+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:56:51.136855+0000","last_undegraded":"2024-05-12T22:56:51.136855+0000","last_fullsized":"2024-05-12T22:56:51.136855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:12.228858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:56.400544+0000","last_change":"2024-05-12T22:52:34.563363+0000","last_active":"2024-05-12T22:56:56.400544+0000","last_peered":"2024-05-12T22:56:56.400544+0000","last_clean":"2024-05-12T22:56:56.400544+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:56:56.400544+0000","last_undegraded":"2024-05-12T22:56:56.400544+0000","last_fullsized":"2024-05-12T22:56:56.400544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.136287+0000","last_change":"2024-05-12T22:52:35.554256+0000","last_active":"2024-05-12T22:56:51.136287+0000","last_peered":"2024-05-12T22:56:51.136287+0000","last_clean":"2024-05-12T22:56:51.136287+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:56:51.136287+0000","last_undegraded":"2024-05-12T22:56:51.136287+0000","last_fullsized":"2024-05-12T22:56:51.136287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:13:18.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:23.632252+0000","last_change":"2024-05-12T22:52:34.580312+0000","last_active":"2024-05-12T22:54:23.632252+0000","last_peered":"2024-05-12T22:54:23.632252+0000","last_clean":"2024-05-12T22:54:23.632252+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:54:23.632252+0000","last_undegraded":"2024-05-12T22:54:23.632252+0000","last_fullsized":"2024-05-12T22:54:23.632252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:42:39.365178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'7","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.176624+0000","last_change":"2024-05-12T22:52:35.580165+0000","last_active":"2024-05-12T22:56:51.176624+0000","last_peered":"2024-05-12T22:56:51.176624+0000","last_clean":"2024-05-12T22:56:51.176624+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:56:51.176624+0000","last_undegraded":"2024-05-12T22:56:51.176624+0000","last_fullsized":"2024-05-12T22:56:51.176624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:03:24.550141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'14","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.186756+0000","last_change":"2024-05-12T22:52:35.597371+0000","last_active":"2024-05-12T22:56:51.186756+0000","last_peered":"2024-05-12T22:56:51.186756+0000","last_clean":"2024-05-12T22:56:51.186756+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:56:51.186756+0000","last_undegraded":"2024-05-12T22:56:51.186756+0000","last_fullsized":"2024-05-12T22:56:51.186756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:25:45.824411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:55:07.401253+0000","last_change":"2024-05-12T22:52:34.576099+0000","last_active":"2024-05-12T22:55:07.401253+0000","last_peered":"2024-05-12T22:55:07.401253+0000","last_clean":"2024-05-12T22:55:07.401253+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:55:07.401253+0000","last_undegraded":"2024-05-12T22:55:07.401253+0000","last_fullsized":"2024-05-12T22:55:07.401253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:32:04.213082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.146316+0000","last_change":"2024-05-12T22:53:16.700551+0000","last_active":"2024-05-12T22:56:51.146316+0000","last_peered":"2024-05-12T22:56:51.146316+0000","last_clean":"2024-05-12T22:56:51.146316+0000","last_became_active":"2024-05-12T22:53:16.699663+0000","last_became_peered":"2024-05-12T22:53:16.699663+0000","last_unstale":"2024-05-12T22:56:51.146316+0000","last_undegraded":"2024-05-12T22:56:51.146316+0000","last_fullsized":"2024-05-12T22:56:51.146316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:20.634053+0000","last_change":"2024-05-12T22:52:34.576150+0000","last_active":"2024-05-12T22:54:20.634053+0000","last_peered":"2024-05-12T22:54:20.634053+0000","last_clean":"2024-05-12T22:54:20.634053+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:54:20.634053+0000","last_undegraded":"2024-05-12T22:54:20.634053+0000","last_fullsized":"2024-05-12T22:54:20.634053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:26:27.633395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.147163+0000","last_change":"2024-05-12T22:52:35.558668+0000","last_active":"2024-05-12T22:56:51.147163+0000","last_peered":"2024-05-12T22:56:51.147163+0000","last_clean":"2024-05-12T22:56:51.147163+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:56:51.147163+0000","last_undegraded":"2024-05-12T22:56:51.147163+0000","last_fullsized":"2024-05-12T22:56:51.147163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:54:36.393165+0000","last_change":"2024-05-12T22:52:34.551100+0000","last_active":"2024-05-12T22:54:36.393165+0000","last_peered":"2024-05-12T22:54:36.393165+0000","last_clean":"2024-05-12T22:54:36.393165+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:54:36.393165+0000","last_undegraded":"2024-05-12T22:54:36.393165+0000","last_fullsized":"2024-05-12T22:54:36.393165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:57:19.834372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:51.178191+0000","last_change":"2024-05-12T22:52:35.556548+0000","last_active":"2024-05-12T22:56:51.178191+0000","last_peered":"2024-05-12T22:56:51.178191+0000","last_clean":"2024-05-12T22:56:51.178191+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:56:51.178191+0000","last_undegraded":"2024-05-12T22:56:51.178191+0000","last_fullsized":"2024-05-12T22:56:51.178191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:34.510384+0000","last_clean_scrub_stamp":"2024-05-12T22:52:34.510384+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:06:35.014150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:56:46.421508+0000","last_change":"2024-05-12T22:52:34.576982+0000","last_active":"2024-05-12T22:56:46.421508+0000","last_peered":"2024-05-12T22:56:46.421508+0000","last_clean":"2024-05-12T22:56:46.421508+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:56:46.421508+0000","last_undegraded":"2024-05-12T22:56:46.421508+0000","last_fullsized":"2024-05-12T22:56:46.421508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:52:33.501530+0000","last_clean_scrub_stamp":"2024-05-12T22:52:33.501530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":799303,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":179,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":1598606,"data_compressed":229594,"data_compressed_allocated":278528,"data_compressed_original":1400832,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":675733,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":872380,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":84873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542203,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":883288,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":95691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":675789,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":798505,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":787597,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.164 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.165 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.166 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.167 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.168 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.169 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.170 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-12T22:52:21.468428+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.171 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.172 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.173 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-12T22:52:34.510384+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=34, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-12T22:52:33.501530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=52, tm_sec=33, tm_wday=6, tm_yday=133, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=12, tm_hour=22, tm_min=56, tm_sec=58, tm_wday=6, tm_yday=133, tm_isdst=0) 2024-05-12T22:57:04.174 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-12T22:57:24.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-12T22:57:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 Processor -- start 2024-05-12T22:57:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 -- start start 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 0x7f2ee01411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0151de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00bdbe0 con 0x7f2ee00bd800 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee00b6f40 con 0x7f2ee0147db0 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2ee5f1d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00b56e0 con 0x7f2ee0141720 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edeffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 0x7f2ee01411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edffff640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edeffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 0x7f2ee01411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.40:35674/0 (socket says 172.21.15.40:35674) 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edf7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2ee00bd800 0x7f2ee01476a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:38046/0 (socket says 172.21.15.40:38046) 2024-05-12T22:57:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edeffd640 1 -- 172.21.15.40:0/3766933910 learned_addr learned my addr 172.21.15.40:0/3766933910 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edffff640 1 -- 172.21.15.40:0/3766933910 >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 msgr2=0x7f2ee01411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edffff640 1 --2- 172.21.15.40:0/3766933910 >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 0x7f2ee01411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edffff640 1 -- 172.21.15.40:0/3766933910 >> v1:172.21.15.47:6789/0 conn(0x7f2ee00bd800 legacy=0x7f2ee01476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.312+0000 7f2edffff640 1 -- 172.21.15.40:0/3766933910 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee00b59c0 con 0x7f2ee0141720 2024-05-12T22:57:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2edffff640 1 --2- 172.21.15.40:0/3766933910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0151de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009d90 tx=0x7f2ed801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e423d87e4d8feb server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ede7fc640 1 -- 172.21.15.40:0/3766933910 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80b2070 con 0x7f2ee0141720 2024-05-12T22:57:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ede7fc640 1 -- 172.21.15.40:0/3766933910 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed80a5710 con 0x7f2ee0141720 2024-05-12T22:57:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ede7fc640 1 -- 172.21.15.40:0/3766933910 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80a5ae0 con 0x7f2ee0141720 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/3766933910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 msgr2=0x7f2ee0151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/3766933910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0151de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009d90 tx=0x7f2ed801c850 comp rx=0 tx=0).stop 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/3766933910 shutdown_connections 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/3766933910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0151de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/3766933910 >> v2:172.21.15.47:3300/0 conn(0x7f2ee0147db0 0x7f2ee01411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/3766933910 >> 172.21.15.40:0/3766933910 conn(0x7f2ee0072ff0 msgr2=0x7f2ee00bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/3766933910 shutdown_connections 2024-05-12T22:57:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/3766933910 wait complete. 2024-05-12T22:57:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 Processor -- start 2024-05-12T22:57:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 -- start start 2024-05-12T22:57:24.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.316+0000 7f2ee5f1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ee0147db0 0x7f2ee01e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00b4660 con 0x7f2ee00bd800 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00b44e0 con 0x7f2ee0147db0 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee0154b40 con 0x7f2ee0141720 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52002/0 (socket says 172.21.15.40:52002) 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 -- 172.21.15.40:0/1899409074 learned_addr learned my addr 172.21.15.40:0/1899409074 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edeffd640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edffff640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ee0147db0 0x7f2ee01e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 -- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 msgr2=0x7f2ee0148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 -- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ee0147db0 msgr2=0x7f2ee01e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ee0147db0 0x7f2ee01e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 -- 172.21.15.40:0/1899409074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee01491a0 con 0x7f2ee00bd800 2024-05-12T22:57:24.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edf7fe640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c450 tx=0x7f2ed000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0017070 con 0x7f2ee00bd800 2024-05-12T22:57:24.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0005c30 con 0x7f2ee00bd800 2024-05-12T22:57:24.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee0149450 con 0x7f2ee00bd800 2024-05-12T22:57:24.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0007070 con 0x7f2ee00bd800 2024-05-12T22:57:24.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee0144400 con 0x7f2ee00bd800 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee0068330 con 0x7f2ee00bd800 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ed001a070 con 0x7f2ee00bd800 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 0x7f2ecc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2ed0084f60 con 0x7f2ee00bd800 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edeffd640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 0x7f2ecc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.320+0000 7f2edeffd640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 0x7f2ecc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ee01e4060 tx=0x7f2ed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.324+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2ed0055ab0 con 0x7f2ee00bd800 2024-05-12T22:57:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.484+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 --> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ee01456b0 con 0x7f2ecc0678c0 2024-05-12T22:57:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.488+0000 7f2ec7fff640 1 -- 172.21.15.40:0/1899409074 <== mgr.4104 v2:172.21.15.40:6832/1199194677 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252410 (secure 0 0 0) 0x7f2ee01456b0 con 0x7f2ecc0678c0 2024-05-12T22:57:24.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:57:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 msgr2=0x7f2ecc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 0x7f2ecc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ee01e4060 tx=0x7f2ed4008040 comp rx=0 tx=0).stop 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 msgr2=0x7f2ee013e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c450 tx=0x7f2ed000c910 comp rx=0 tx=0).stop 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 shutdown_connections 2024-05-12T22:57:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f2ecc0678c0 0x7f2ecc069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ee0147db0 0x7f2ee01e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ee0141720 0x7f2ee0148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 --2- 172.21.15.40:0/1899409074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee00bd800 0x7f2ee013e6f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 >> 172.21.15.40:0/1899409074 conn(0x7f2ee0072ff0 msgr2=0x7f2ee0074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 shutdown_connections 2024-05-12T22:57:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.492+0000 7f2ee5f1d640 1 -- 172.21.15.40:0/1899409074 wait complete. 2024-05-12T22:57:24.513 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-05-12T22:57:23.435418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389671,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":344,"num_write_kb":3287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":891,"ondisk_log_size":891,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239408,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754735312,"statfs":{"total":773094113280,"available":772848959488,"internally_reserved":0,"allocated":2539520,"data_stored":3457606,"data_compressed":296616,"data_compressed_allocated":368640,"data_compressed_original":2547712,"omap_allocated":12747,"internal_metadata":242535989},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:17.048656+0000","last_change":"2024-05-12T22:57:17.048715+0000","last_active":"2024-05-12T22:57:17.048656+0000","last_peered":"2024-05-12T22:57:17.048656+0000","last_clean":"2024-05-12T22:57:17.048656+0000","last_became_active":"2024-05-12T22:52:35.588299+0000","last_became_peered":"2024-05-12T22:52:35.588299+0000","last_unstale":"2024-05-12T22:57:17.048656+0000","last_undegraded":"2024-05-12T22:57:17.048656+0000","last_fullsized":"2024-05-12T22:57:17.048656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-05-12T22:57:17.048482+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-05-12T22:57:17.048482+0000","last_clean_scrub_stamp":"2024-05-12T22:57:17.048482+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:00:05.199231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.584362+0000","last_change":"2024-05-12T22:57:09.584422+0000","last_active":"2024-05-12T22:57:09.584362+0000","last_peered":"2024-05-12T22:57:09.584362+0000","last_clean":"2024-05-12T22:57:09.584362+0000","last_became_active":"2024-05-12T22:52:35.552445+0000","last_became_peered":"2024-05-12T22:52:35.552445+0000","last_unstale":"2024-05-12T22:57:09.584362+0000","last_undegraded":"2024-05-12T22:57:09.584362+0000","last_fullsized":"2024-05-12T22:57:09.584362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:09.584183+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:09.584183+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.584183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:10:08.990988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.491105+0000","last_change":"2024-05-12T22:57:03.491151+0000","last_active":"2024-05-12T22:57:03.491105+0000","last_peered":"2024-05-12T22:57:03.491105+0000","last_clean":"2024-05-12T22:57:03.491105+0000","last_became_active":"2024-05-12T22:52:35.539515+0000","last_became_peered":"2024-05-12T22:52:35.539515+0000","last_unstale":"2024-05-12T22:57:03.491105+0000","last_undegraded":"2024-05-12T22:57:03.491105+0000","last_fullsized":"2024-05-12T22:57:03.491105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:03.491028+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:03.491028+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.491028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:09:52.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.304027+0000","last_change":"2024-05-12T22:57:11.304093+0000","last_active":"2024-05-12T22:57:11.304027+0000","last_peered":"2024-05-12T22:57:11.304027+0000","last_clean":"2024-05-12T22:57:11.304027+0000","last_became_active":"2024-05-12T22:52:35.558654+0000","last_became_peered":"2024-05-12T22:52:35.558654+0000","last_unstale":"2024-05-12T22:57:11.304027+0000","last_undegraded":"2024-05-12T22:57:11.304027+0000","last_fullsized":"2024-05-12T22:57:11.304027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:11.303855+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:11.303855+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.303855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:40:00.467632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'6","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:15.040487+0000","last_change":"2024-05-12T22:57:15.040547+0000","last_active":"2024-05-12T22:57:15.040487+0000","last_peered":"2024-05-12T22:57:15.040487+0000","last_clean":"2024-05-12T22:57:15.040487+0000","last_became_active":"2024-05-12T22:52:35.587765+0000","last_became_peered":"2024-05-12T22:52:35.587765+0000","last_unstale":"2024-05-12T22:57:15.040487+0000","last_undegraded":"2024-05-12T22:57:15.040487+0000","last_fullsized":"2024-05-12T22:57:15.040487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:15.040287+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:15.040287+0000","last_clean_scrub_stamp":"2024-05-12T22:57:15.040287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:58:05.493751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'5","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:13.281363+0000","last_change":"2024-05-12T22:57:13.281429+0000","last_active":"2024-05-12T22:57:13.281363+0000","last_peered":"2024-05-12T22:57:13.281363+0000","last_clean":"2024-05-12T22:57:13.281363+0000","last_became_active":"2024-05-12T22:52:35.565856+0000","last_became_peered":"2024-05-12T22:52:35.565856+0000","last_unstale":"2024-05-12T22:57:13.281363+0000","last_undegraded":"2024-05-12T22:57:13.281363+0000","last_fullsized":"2024-05-12T22:57:13.281363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:13.281154+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:13.281154+0000","last_clean_scrub_stamp":"2024-05-12T22:57:13.281154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:16:47.635811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'5","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.129664+0000","last_change":"2024-05-12T22:57:04.129724+0000","last_active":"2024-05-12T22:57:04.129664+0000","last_peered":"2024-05-12T22:57:04.129664+0000","last_clean":"2024-05-12T22:57:04.129664+0000","last_became_active":"2024-05-12T22:52:35.585637+0000","last_became_peered":"2024-05-12T22:52:35.585637+0000","last_unstale":"2024-05-12T22:57:04.129664+0000","last_undegraded":"2024-05-12T22:57:04.129664+0000","last_fullsized":"2024-05-12T22:57:04.129664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:04.129490+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:04.129490+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.129490+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:37:37.376172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'6","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.754131+0000","last_change":"2024-05-12T22:57:11.754191+0000","last_active":"2024-05-12T22:57:11.754131+0000","last_peered":"2024-05-12T22:57:11.754131+0000","last_clean":"2024-05-12T22:57:11.754131+0000","last_became_active":"2024-05-12T22:52:35.569197+0000","last_became_peered":"2024-05-12T22:52:35.569197+0000","last_unstale":"2024-05-12T22:57:11.754131+0000","last_undegraded":"2024-05-12T22:57:11.754131+0000","last_fullsized":"2024-05-12T22:57:11.754131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:11.753953+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:11.753953+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.753953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:03:00.972319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'9","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:14.084114+0000","last_change":"2024-05-12T22:57:14.084180+0000","last_active":"2024-05-12T22:57:14.084114+0000","last_peered":"2024-05-12T22:57:14.084114+0000","last_clean":"2024-05-12T22:57:14.084114+0000","last_became_active":"2024-05-12T22:52:35.586755+0000","last_became_peered":"2024-05-12T22:52:35.586755+0000","last_unstale":"2024-05-12T22:57:14.084114+0000","last_undegraded":"2024-05-12T22:57:14.084114+0000","last_fullsized":"2024-05-12T22:57:14.084114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:14.083932+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:14.083932+0000","last_clean_scrub_stamp":"2024-05-12T22:57:14.083932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:05:25.855987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'16","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.942669+0000","last_change":"2024-05-12T22:57:11.942730+0000","last_active":"2024-05-12T22:57:11.942669+0000","last_peered":"2024-05-12T22:57:11.942669+0000","last_clean":"2024-05-12T22:57:11.942669+0000","last_became_active":"2024-05-12T22:52:35.569227+0000","last_became_peered":"2024-05-12T22:52:35.569227+0000","last_unstale":"2024-05-12T22:57:11.942669+0000","last_undegraded":"2024-05-12T22:57:11.942669+0000","last_fullsized":"2024-05-12T22:57:11.942669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-05-12T22:57:11.942471+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-05-12T22:57:11.942471+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.942471+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:51:12.269296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'6","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.907897+0000","last_change":"2024-05-12T22:57:10.907964+0000","last_active":"2024-05-12T22:57:10.907897+0000","last_peered":"2024-05-12T22:57:10.907897+0000","last_clean":"2024-05-12T22:57:10.907897+0000","last_became_active":"2024-05-12T22:52:35.567912+0000","last_became_peered":"2024-05-12T22:52:35.567912+0000","last_unstale":"2024-05-12T22:57:10.907897+0000","last_undegraded":"2024-05-12T22:57:10.907897+0000","last_fullsized":"2024-05-12T22:57:10.907897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:10.907686+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:10.907686+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.907686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:18:12.746908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'6","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.751910+0000","last_change":"2024-05-12T22:57:06.752026+0000","last_active":"2024-05-12T22:57:06.751910+0000","last_peered":"2024-05-12T22:57:06.751910+0000","last_clean":"2024-05-12T22:57:06.751910+0000","last_became_active":"2024-05-12T22:52:35.584576+0000","last_became_peered":"2024-05-12T22:52:35.584576+0000","last_unstale":"2024-05-12T22:57:06.751910+0000","last_undegraded":"2024-05-12T22:57:06.751910+0000","last_fullsized":"2024-05-12T22:57:06.751910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:06.751578+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:06.751578+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.751578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:33:38.720671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'10","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.755031+0000","last_change":"2024-05-12T22:57:06.755090+0000","last_active":"2024-05-12T22:57:06.755031+0000","last_peered":"2024-05-12T22:57:06.755031+0000","last_clean":"2024-05-12T22:57:06.755031+0000","last_became_active":"2024-05-12T22:52:35.550301+0000","last_became_peered":"2024-05-12T22:52:35.550301+0000","last_unstale":"2024-05-12T22:57:06.755031+0000","last_undegraded":"2024-05-12T22:57:06.755031+0000","last_fullsized":"2024-05-12T22:57:06.755031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-05-12T22:57:06.754862+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-05-12T22:57:06.754862+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.754862+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:33:52.516003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.565024+0000","last_change":"2024-05-12T22:57:05.565024+0000","last_active":"2024-05-12T22:57:05.565024+0000","last_peered":"2024-05-12T22:57:05.565024+0000","last_clean":"2024-05-12T22:57:05.565024+0000","last_became_active":"2024-05-12T22:52:35.549880+0000","last_became_peered":"2024-05-12T22:52:35.549880+0000","last_unstale":"2024-05-12T22:57:05.565024+0000","last_undegraded":"2024-05-12T22:57:05.565024+0000","last_fullsized":"2024-05-12T22:57:05.565024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:05.564790+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:05.564790+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.564790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:48:55.384695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.543433+0000","last_change":"2024-05-12T22:57:11.543433+0000","last_active":"2024-05-12T22:57:11.543433+0000","last_peered":"2024-05-12T22:57:11.543433+0000","last_clean":"2024-05-12T22:57:11.543433+0000","last_became_active":"2024-05-12T22:52:35.585336+0000","last_became_peered":"2024-05-12T22:52:35.585336+0000","last_unstale":"2024-05-12T22:57:11.543433+0000","last_undegraded":"2024-05-12T22:57:11.543433+0000","last_fullsized":"2024-05-12T22:57:11.543433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:11.543196+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:11.543196+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.543196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:27:53.666486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'11","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.540820+0000","last_change":"2024-05-12T22:57:08.540885+0000","last_active":"2024-05-12T22:57:08.540820+0000","last_peered":"2024-05-12T22:57:08.540820+0000","last_clean":"2024-05-12T22:57:08.540820+0000","last_became_active":"2024-05-12T22:53:16.796573+0000","last_became_peered":"2024-05-12T22:53:16.796573+0000","last_unstale":"2024-05-12T22:57:08.540820+0000","last_undegraded":"2024-05-12T22:57:08.540820+0000","last_fullsized":"2024-05-12T22:57:08.540820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-12T22:57:08.540630+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-12T22:57:08.540630+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.540630+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:53:37.778044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:14.317767+0000","last_change":"2024-05-12T22:57:14.317767+0000","last_active":"2024-05-12T22:57:14.317767+0000","last_peered":"2024-05-12T22:57:14.317767+0000","last_clean":"2024-05-12T22:57:14.317767+0000","last_became_active":"2024-05-12T22:52:35.573953+0000","last_became_peered":"2024-05-12T22:52:35.573953+0000","last_unstale":"2024-05-12T22:57:14.317767+0000","last_undegraded":"2024-05-12T22:57:14.317767+0000","last_fullsized":"2024-05-12T22:57:14.317767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:14.317319+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:14.317319+0000","last_clean_scrub_stamp":"2024-05-12T22:57:14.317319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:05:26.089373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.447012+0000","last_change":"2024-05-12T22:57:05.447012+0000","last_active":"2024-05-12T22:57:05.447012+0000","last_peered":"2024-05-12T22:57:05.447012+0000","last_clean":"2024-05-12T22:57:05.447012+0000","last_became_active":"2024-05-12T22:52:35.564494+0000","last_became_peered":"2024-05-12T22:52:35.564494+0000","last_unstale":"2024-05-12T22:57:05.447012+0000","last_undegraded":"2024-05-12T22:57:05.447012+0000","last_fullsized":"2024-05-12T22:57:05.447012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-05-12T22:57:05.446727+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-05-12T22:57:05.446727+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.446727+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:14:54.460659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:16.035996+0000","last_change":"2024-05-12T22:57:16.036055+0000","last_active":"2024-05-12T22:57:16.035996+0000","last_peered":"2024-05-12T22:57:16.035996+0000","last_clean":"2024-05-12T22:57:16.035996+0000","last_became_active":"2024-05-12T22:52:35.587619+0000","last_became_peered":"2024-05-12T22:52:35.587619+0000","last_unstale":"2024-05-12T22:57:16.035996+0000","last_undegraded":"2024-05-12T22:57:16.035996+0000","last_fullsized":"2024-05-12T22:57:16.035996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:16.035816+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:16.035816+0000","last_clean_scrub_stamp":"2024-05-12T22:57:16.035816+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:05:22.019231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'8","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:14.895779+0000","last_change":"2024-05-12T22:57:14.895841+0000","last_active":"2024-05-12T22:57:14.895779+0000","last_peered":"2024-05-12T22:57:14.895779+0000","last_clean":"2024-05-12T22:57:14.895779+0000","last_became_active":"2024-05-12T22:52:35.598418+0000","last_became_peered":"2024-05-12T22:52:35.598418+0000","last_unstale":"2024-05-12T22:57:14.895779+0000","last_undegraded":"2024-05-12T22:57:14.895779+0000","last_fullsized":"2024-05-12T22:57:14.895779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:14.895598+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:14.895598+0000","last_clean_scrub_stamp":"2024-05-12T22:57:14.895598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:40:04.059374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'11","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.607337+0000","last_change":"2024-05-12T22:57:12.607402+0000","last_active":"2024-05-12T22:57:12.607337+0000","last_peered":"2024-05-12T22:57:12.607337+0000","last_clean":"2024-05-12T22:57:12.607337+0000","last_became_active":"2024-05-12T22:52:35.586109+0000","last_became_peered":"2024-05-12T22:52:35.586109+0000","last_unstale":"2024-05-12T22:57:12.607337+0000","last_undegraded":"2024-05-12T22:57:12.607337+0000","last_fullsized":"2024-05-12T22:57:12.607337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-12T22:57:12.607158+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-12T22:57:12.607158+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.607158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:05:20.853815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'13","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:15.270136+0000","last_change":"2024-05-12T22:57:15.270202+0000","last_active":"2024-05-12T22:57:15.270136+0000","last_peered":"2024-05-12T22:57:15.270136+0000","last_clean":"2024-05-12T22:57:15.270136+0000","last_became_active":"2024-05-12T22:52:35.579453+0000","last_became_peered":"2024-05-12T22:52:35.579453+0000","last_unstale":"2024-05-12T22:57:15.270136+0000","last_undegraded":"2024-05-12T22:57:15.270136+0000","last_fullsized":"2024-05-12T22:57:15.270136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-05-12T22:57:15.269949+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-05-12T22:57:15.269949+0000","last_clean_scrub_stamp":"2024-05-12T22:57:15.269949+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:58:05.723412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'9","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:14.717520+0000","last_change":"2024-05-12T22:57:14.717680+0000","last_active":"2024-05-12T22:57:14.717520+0000","last_peered":"2024-05-12T22:57:14.717520+0000","last_clean":"2024-05-12T22:57:14.717520+0000","last_became_active":"2024-05-12T22:52:35.585194+0000","last_became_peered":"2024-05-12T22:52:35.585194+0000","last_unstale":"2024-05-12T22:57:14.717520+0000","last_undegraded":"2024-05-12T22:57:14.717520+0000","last_fullsized":"2024-05-12T22:57:14.717520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:14.717307+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:14.717307+0000","last_clean_scrub_stamp":"2024-05-12T22:57:14.717307+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:19:29.681457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'9","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.277783+0000","last_change":"2024-05-12T22:57:08.277901+0000","last_active":"2024-05-12T22:57:08.277783+0000","last_peered":"2024-05-12T22:57:08.277783+0000","last_clean":"2024-05-12T22:57:08.277783+0000","last_became_active":"2024-05-12T22:52:35.548520+0000","last_became_peered":"2024-05-12T22:52:35.548520+0000","last_unstale":"2024-05-12T22:57:08.277783+0000","last_undegraded":"2024-05-12T22:57:08.277783+0000","last_fullsized":"2024-05-12T22:57:08.277783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:08.277496+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:08.277496+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.277496+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:28:44.869558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:13.710590+0000","last_change":"2024-05-12T22:57:13.710719+0000","last_active":"2024-05-12T22:57:13.710590+0000","last_peered":"2024-05-12T22:57:13.710590+0000","last_clean":"2024-05-12T22:57:13.710590+0000","last_became_active":"2024-05-12T22:52:35.577354+0000","last_became_peered":"2024-05-12T22:52:35.577354+0000","last_unstale":"2024-05-12T22:57:13.710590+0000","last_undegraded":"2024-05-12T22:57:13.710590+0000","last_fullsized":"2024-05-12T22:57:13.710590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:13.710298+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:13.710298+0000","last_clean_scrub_stamp":"2024-05-12T22:57:13.710298+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:40:16.095882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'13","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:13.942318+0000","last_change":"2024-05-12T22:57:13.942386+0000","last_active":"2024-05-12T22:57:13.942318+0000","last_peered":"2024-05-12T22:57:13.942318+0000","last_clean":"2024-05-12T22:57:13.942318+0000","last_became_active":"2024-05-12T22:52:35.587246+0000","last_became_peered":"2024-05-12T22:52:35.587246+0000","last_unstale":"2024-05-12T22:57:13.942318+0000","last_undegraded":"2024-05-12T22:57:13.942318+0000","last_fullsized":"2024-05-12T22:57:13.942318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-05-12T22:57:13.942098+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-05-12T22:57:13.942098+0000","last_clean_scrub_stamp":"2024-05-12T22:57:13.942098+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:03:03.160464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'6","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.546798+0000","last_change":"2024-05-12T22:57:12.546862+0000","last_active":"2024-05-12T22:57:12.546798+0000","last_peered":"2024-05-12T22:57:12.546798+0000","last_clean":"2024-05-12T22:57:12.546798+0000","last_became_active":"2024-05-12T22:53:16.704085+0000","last_became_peered":"2024-05-12T22:53:16.704085+0000","last_unstale":"2024-05-12T22:57:12.546798+0000","last_undegraded":"2024-05-12T22:57:12.546798+0000","last_fullsized":"2024-05-12T22:57:12.546798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:12.546616+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:12.546616+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.546616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:27:48.751073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:15.726554+0000","last_change":"2024-05-12T22:57:15.726619+0000","last_active":"2024-05-12T22:57:15.726554+0000","last_peered":"2024-05-12T22:57:15.726554+0000","last_clean":"2024-05-12T22:57:15.726554+0000","last_became_active":"2024-05-12T22:52:35.591026+0000","last_became_peered":"2024-05-12T22:52:35.591026+0000","last_unstale":"2024-05-12T22:57:15.726554+0000","last_undegraded":"2024-05-12T22:57:15.726554+0000","last_fullsized":"2024-05-12T22:57:15.726554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:15.726323+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:15.726323+0000","last_clean_scrub_stamp":"2024-05-12T22:57:15.726323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:05:27.498377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.532799+0000","last_change":"2024-05-12T22:57:04.532859+0000","last_active":"2024-05-12T22:57:04.532799+0000","last_peered":"2024-05-12T22:57:04.532799+0000","last_clean":"2024-05-12T22:57:04.532799+0000","last_became_active":"2024-05-12T22:52:35.546111+0000","last_became_peered":"2024-05-12T22:52:35.546111+0000","last_unstale":"2024-05-12T22:57:04.532799+0000","last_undegraded":"2024-05-12T22:57:04.532799+0000","last_fullsized":"2024-05-12T22:57:04.532799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:04.532625+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:04.532625+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.532625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:36:58.603315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.323058+0000","last_change":"2024-05-12T22:57:12.323118+0000","last_active":"2024-05-12T22:57:12.323058+0000","last_peered":"2024-05-12T22:57:12.323058+0000","last_clean":"2024-05-12T22:57:12.323058+0000","last_became_active":"2024-05-12T22:52:35.564120+0000","last_became_peered":"2024-05-12T22:52:35.564120+0000","last_unstale":"2024-05-12T22:57:12.323058+0000","last_undegraded":"2024-05-12T22:57:12.323058+0000","last_fullsized":"2024-05-12T22:57:12.323058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:12.322890+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:12.322890+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.322890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:40:14.708473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.483588+0000","last_change":"2024-05-12T22:57:06.483702+0000","last_active":"2024-05-12T22:57:06.483588+0000","last_peered":"2024-05-12T22:57:06.483588+0000","last_clean":"2024-05-12T22:57:06.483588+0000","last_became_active":"2024-05-12T22:52:35.567714+0000","last_became_peered":"2024-05-12T22:52:35.567714+0000","last_unstale":"2024-05-12T22:57:06.483588+0000","last_undegraded":"2024-05-12T22:57:06.483588+0000","last_fullsized":"2024-05-12T22:57:06.483588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:06.483369+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:06.483369+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.483369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:10:03.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'8","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.920971+0000","last_change":"2024-05-12T22:57:08.921035+0000","last_active":"2024-05-12T22:57:08.920971+0000","last_peered":"2024-05-12T22:57:08.920971+0000","last_clean":"2024-05-12T22:57:08.920971+0000","last_became_active":"2024-05-12T22:52:35.551755+0000","last_became_peered":"2024-05-12T22:52:35.551755+0000","last_unstale":"2024-05-12T22:57:08.920971+0000","last_undegraded":"2024-05-12T22:57:08.920971+0000","last_fullsized":"2024-05-12T22:57:08.920971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:08.920788+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:08.920788+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.920788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:33:54.681929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'7","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.792157+0000","last_change":"2024-05-12T22:57:04.792219+0000","last_active":"2024-05-12T22:57:04.792157+0000","last_peered":"2024-05-12T22:57:04.792157+0000","last_clean":"2024-05-12T22:57:04.792157+0000","last_became_active":"2024-05-12T22:52:35.590054+0000","last_became_peered":"2024-05-12T22:52:35.590054+0000","last_unstale":"2024-05-12T22:57:04.792157+0000","last_undegraded":"2024-05-12T22:57:04.792157+0000","last_fullsized":"2024-05-12T22:57:04.792157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:04.791984+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:04.791984+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.791984+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:46:18.267592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.668279+0000","last_change":"2024-05-12T22:57:03.668321+0000","last_active":"2024-05-12T22:57:03.668279+0000","last_peered":"2024-05-12T22:57:03.668279+0000","last_clean":"2024-05-12T22:57:03.668279+0000","last_became_active":"2024-05-12T22:52:34.561232+0000","last_became_peered":"2024-05-12T22:52:34.561232+0000","last_unstale":"2024-05-12T22:57:03.668279+0000","last_undegraded":"2024-05-12T22:57:03.668279+0000","last_fullsized":"2024-05-12T22:57:03.668279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:03.668169+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:03.668169+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.668169+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:46:39.455952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'7","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.636605+0000","last_change":"2024-05-12T22:57:11.636670+0000","last_active":"2024-05-12T22:57:11.636605+0000","last_peered":"2024-05-12T22:57:11.636605+0000","last_clean":"2024-05-12T22:57:11.636605+0000","last_became_active":"2024-05-12T22:52:35.578514+0000","last_became_peered":"2024-05-12T22:52:35.578514+0000","last_unstale":"2024-05-12T22:57:11.636605+0000","last_undegraded":"2024-05-12T22:57:11.636605+0000","last_fullsized":"2024-05-12T22:57:11.636605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:11.636401+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:11.636401+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.636401+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:25:55.915346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.950866+0000","last_change":"2024-05-12T22:57:05.950929+0000","last_active":"2024-05-12T22:57:05.950866+0000","last_peered":"2024-05-12T22:57:05.950866+0000","last_clean":"2024-05-12T22:57:05.950866+0000","last_became_active":"2024-05-12T22:52:34.568386+0000","last_became_peered":"2024-05-12T22:52:34.568386+0000","last_unstale":"2024-05-12T22:57:05.950866+0000","last_undegraded":"2024-05-12T22:57:05.950866+0000","last_fullsized":"2024-05-12T22:57:05.950866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:05.950689+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:05.950689+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.950689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:46:41.738473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'2","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.664546+0000","last_change":"2024-05-12T22:57:04.664692+0000","last_active":"2024-05-12T22:57:04.664546+0000","last_peered":"2024-05-12T22:57:04.664546+0000","last_clean":"2024-05-12T22:57:04.664546+0000","last_became_active":"2024-05-12T22:52:34.569714+0000","last_became_peered":"2024-05-12T22:52:34.569714+0000","last_unstale":"2024-05-12T22:57:04.664546+0000","last_undegraded":"2024-05-12T22:57:04.664546+0000","last_fullsized":"2024-05-12T22:57:04.664546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-05-12T22:57:04.664347+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-05-12T22:57:04.664347+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.664347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:04:20.194279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'6","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.711270+0000","last_change":"2024-05-12T22:57:05.711334+0000","last_active":"2024-05-12T22:57:05.711270+0000","last_peered":"2024-05-12T22:57:05.711270+0000","last_clean":"2024-05-12T22:57:05.711270+0000","last_became_active":"2024-05-12T22:52:35.546900+0000","last_became_peered":"2024-05-12T22:52:35.546900+0000","last_unstale":"2024-05-12T22:57:05.711270+0000","last_undegraded":"2024-05-12T22:57:05.711270+0000","last_fullsized":"2024-05-12T22:57:05.711270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:05.711087+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:05.711087+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.711087+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:37:38.957769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.270847+0000","last_change":"2024-05-12T22:57:06.270908+0000","last_active":"2024-05-12T22:57:06.270847+0000","last_peered":"2024-05-12T22:57:06.270847+0000","last_clean":"2024-05-12T22:57:06.270847+0000","last_became_active":"2024-05-12T22:52:34.565594+0000","last_became_peered":"2024-05-12T22:52:34.565594+0000","last_unstale":"2024-05-12T22:57:06.270847+0000","last_undegraded":"2024-05-12T22:57:06.270847+0000","last_fullsized":"2024-05-12T22:57:06.270847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:06.270675+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:06.270675+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.270675+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:40:07.623076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'11","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.542406+0000","last_change":"2024-05-12T22:57:07.542478+0000","last_active":"2024-05-12T22:57:07.542406+0000","last_peered":"2024-05-12T22:57:07.542406+0000","last_clean":"2024-05-12T22:57:07.542406+0000","last_became_active":"2024-05-12T22:52:35.548594+0000","last_became_peered":"2024-05-12T22:52:35.548594+0000","last_unstale":"2024-05-12T22:57:07.542406+0000","last_undegraded":"2024-05-12T22:57:07.542406+0000","last_fullsized":"2024-05-12T22:57:07.542406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-05-12T22:57:07.542210+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-05-12T22:57:07.542210+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.542210+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:50:23.529095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.967303+0000","last_change":"2024-05-12T22:57:04.967362+0000","last_active":"2024-05-12T22:57:04.967303+0000","last_peered":"2024-05-12T22:57:04.967303+0000","last_clean":"2024-05-12T22:57:04.967303+0000","last_became_active":"2024-05-12T22:52:34.565100+0000","last_became_peered":"2024-05-12T22:52:34.565100+0000","last_unstale":"2024-05-12T22:57:04.967303+0000","last_undegraded":"2024-05-12T22:57:04.967303+0000","last_fullsized":"2024-05-12T22:57:04.967303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:04.967126+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:04.967126+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.967126+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:57:21.350845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:13.585273+0000","last_change":"2024-05-12T22:57:13.585333+0000","last_active":"2024-05-12T22:57:13.585273+0000","last_peered":"2024-05-12T22:57:13.585273+0000","last_clean":"2024-05-12T22:57:13.585273+0000","last_became_active":"2024-05-12T22:53:16.796547+0000","last_became_peered":"2024-05-12T22:53:16.796547+0000","last_unstale":"2024-05-12T22:57:13.585273+0000","last_undegraded":"2024-05-12T22:57:13.585273+0000","last_fullsized":"2024-05-12T22:57:13.585273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:13.585094+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:13.585094+0000","last_clean_scrub_stamp":"2024-05-12T22:57:13.585094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:48:08.246643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"23'7","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.285729+0000","last_change":"2024-05-12T22:57:07.285860+0000","last_active":"2024-05-12T22:57:07.285729+0000","last_peered":"2024-05-12T22:57:07.285729+0000","last_clean":"2024-05-12T22:57:07.285729+0000","last_became_active":"2024-05-12T22:52:34.569616+0000","last_became_peered":"2024-05-12T22:52:34.569616+0000","last_unstale":"2024-05-12T22:57:07.285729+0000","last_undegraded":"2024-05-12T22:57:07.285729+0000","last_fullsized":"2024-05-12T22:57:07.285729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:07.285510+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:07.285510+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.285510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:18:09.124732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'9","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.601691+0000","last_change":"2024-05-12T22:57:08.601751+0000","last_active":"2024-05-12T22:57:08.601691+0000","last_peered":"2024-05-12T22:57:08.601691+0000","last_clean":"2024-05-12T22:57:08.601691+0000","last_became_active":"2024-05-12T22:52:35.558343+0000","last_became_peered":"2024-05-12T22:52:35.558343+0000","last_unstale":"2024-05-12T22:57:08.601691+0000","last_undegraded":"2024-05-12T22:57:08.601691+0000","last_fullsized":"2024-05-12T22:57:08.601691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:08.601517+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:08.601517+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.601517+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:50:24.588403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.594482+0000","last_change":"2024-05-12T22:57:05.594637+0000","last_active":"2024-05-12T22:57:05.594482+0000","last_peered":"2024-05-12T22:57:05.594482+0000","last_clean":"2024-05-12T22:57:05.594482+0000","last_became_active":"2024-05-12T22:52:34.563993+0000","last_became_peered":"2024-05-12T22:52:34.563993+0000","last_unstale":"2024-05-12T22:57:05.594482+0000","last_undegraded":"2024-05-12T22:57:05.594482+0000","last_fullsized":"2024-05-12T22:57:05.594482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-05-12T22:57:05.594277+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-05-12T22:57:05.594277+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.594277+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:29:04.303409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.774681+0000","last_change":"2024-05-12T22:57:05.774681+0000","last_active":"2024-05-12T22:57:05.774681+0000","last_peered":"2024-05-12T22:57:05.774681+0000","last_clean":"2024-05-12T22:57:05.774681+0000","last_became_active":"2024-05-12T22:52:35.589640+0000","last_became_peered":"2024-05-12T22:52:35.589640+0000","last_unstale":"2024-05-12T22:57:05.774681+0000","last_undegraded":"2024-05-12T22:57:05.774681+0000","last_fullsized":"2024-05-12T22:57:05.774681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-05-12T22:57:05.774312+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-05-12T22:57:05.774312+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.774312+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:54:46.745109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'52","reported_seq":80,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.949093+0000","last_change":"2024-05-12T22:57:06.949093+0000","last_active":"2024-05-12T22:57:06.949093+0000","last_peered":"2024-05-12T22:57:06.949093+0000","last_clean":"2024-05-12T22:57:06.949093+0000","last_became_active":"2024-05-12T22:52:34.566858+0000","last_became_peered":"2024-05-12T22:52:34.566858+0000","last_unstale":"2024-05-12T22:57:06.949093+0000","last_undegraded":"2024-05-12T22:57:06.949093+0000","last_fullsized":"2024-05-12T22:57:06.949093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'52","last_scrub_stamp":"2024-05-12T22:57:06.948835+0000","last_deep_scrub":"23'52","last_deep_scrub_stamp":"2024-05-12T22:57:06.948835+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.948835+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:04:22.478767+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":787597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'6","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:13.116951+0000","last_change":"2024-05-12T22:57:13.117010+0000","last_active":"2024-05-12T22:57:13.116951+0000","last_peered":"2024-05-12T22:57:13.116951+0000","last_clean":"2024-05-12T22:57:13.116951+0000","last_became_active":"2024-05-12T22:52:35.567314+0000","last_became_peered":"2024-05-12T22:52:35.567314+0000","last_unstale":"2024-05-12T22:57:13.116951+0000","last_undegraded":"2024-05-12T22:57:13.116951+0000","last_fullsized":"2024-05-12T22:57:13.116951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:13.116773+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:13.116773+0000","last_clean_scrub_stamp":"2024-05-12T22:57:13.116773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:19:28.080923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:01.427819+0000","last_change":"2024-05-12T22:57:01.427877+0000","last_active":"2024-05-12T22:57:01.427819+0000","last_peered":"2024-05-12T22:57:01.427819+0000","last_clean":"2024-05-12T22:57:01.427819+0000","last_became_active":"2024-05-12T22:52:34.567574+0000","last_became_peered":"2024-05-12T22:52:34.567574+0000","last_unstale":"2024-05-12T22:57:01.427819+0000","last_undegraded":"2024-05-12T22:57:01.427819+0000","last_fullsized":"2024-05-12T22:57:01.427819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:01.427723+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:01.427723+0000","last_clean_scrub_stamp":"2024-05-12T22:57:01.427723+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:53:08.367938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.573371+0000","last_change":"2024-05-12T22:57:09.573371+0000","last_active":"2024-05-12T22:57:09.573371+0000","last_peered":"2024-05-12T22:57:09.573371+0000","last_clean":"2024-05-12T22:57:09.573371+0000","last_became_active":"2024-05-12T22:52:35.565827+0000","last_became_peered":"2024-05-12T22:52:35.565827+0000","last_unstale":"2024-05-12T22:57:09.573371+0000","last_undegraded":"2024-05-12T22:57:09.573371+0000","last_fullsized":"2024-05-12T22:57:09.573371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:09.573141+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:09.573141+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.573141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:03:57.177377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'8","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.309899+0000","last_change":"2024-05-12T22:57:03.309899+0000","last_active":"2024-05-12T22:57:03.309899+0000","last_peered":"2024-05-12T22:57:03.309899+0000","last_clean":"2024-05-12T22:57:03.309899+0000","last_became_active":"2024-05-12T22:52:34.544149+0000","last_became_peered":"2024-05-12T22:52:34.544149+0000","last_unstale":"2024-05-12T22:57:03.309899+0000","last_undegraded":"2024-05-12T22:57:03.309899+0000","last_fullsized":"2024-05-12T22:57:03.309899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:03.309654+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:03.309654+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.309654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:55:56.113374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'20","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:18.035948+0000","last_change":"2024-05-12T22:57:18.036098+0000","last_active":"2024-05-12T22:57:18.035948+0000","last_peered":"2024-05-12T22:57:18.035948+0000","last_clean":"2024-05-12T22:57:18.035948+0000","last_became_active":"2024-05-12T22:52:35.591570+0000","last_became_peered":"2024-05-12T22:52:35.591570+0000","last_unstale":"2024-05-12T22:57:18.035948+0000","last_undegraded":"2024-05-12T22:57:18.035948+0000","last_fullsized":"2024-05-12T22:57:18.035948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-05-12T22:57:18.035699+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-05-12T22:57:18.035699+0000","last_clean_scrub_stamp":"2024-05-12T22:57:18.035699+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:02:23.753083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.979654+0000","last_change":"2024-05-12T22:57:03.979654+0000","last_active":"2024-05-12T22:57:03.979654+0000","last_peered":"2024-05-12T22:57:03.979654+0000","last_clean":"2024-05-12T22:57:03.979654+0000","last_became_active":"2024-05-12T22:52:34.563057+0000","last_became_peered":"2024-05-12T22:52:34.563057+0000","last_unstale":"2024-05-12T22:57:03.979654+0000","last_undegraded":"2024-05-12T22:57:03.979654+0000","last_fullsized":"2024-05-12T22:57:03.979654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:03.979293+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:03.979293+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.979293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:51:10.264557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.895958+0000","last_change":"2024-05-12T22:57:09.895958+0000","last_active":"2024-05-12T22:57:09.895958+0000","last_peered":"2024-05-12T22:57:09.895958+0000","last_clean":"2024-05-12T22:57:09.895958+0000","last_became_active":"2024-05-12T22:52:35.551788+0000","last_became_peered":"2024-05-12T22:52:35.551788+0000","last_unstale":"2024-05-12T22:57:09.895958+0000","last_undegraded":"2024-05-12T22:57:09.895958+0000","last_fullsized":"2024-05-12T22:57:09.895958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:09.895718+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:09.895718+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.895718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:40:11.248119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'16","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.513182+0000","last_change":"2024-05-12T22:57:03.513182+0000","last_active":"2024-05-12T22:57:03.513182+0000","last_peered":"2024-05-12T22:57:03.513182+0000","last_clean":"2024-05-12T22:57:03.513182+0000","last_became_active":"2024-05-12T22:52:34.550548+0000","last_became_peered":"2024-05-12T22:52:34.550548+0000","last_unstale":"2024-05-12T22:57:03.513182+0000","last_undegraded":"2024-05-12T22:57:03.513182+0000","last_fullsized":"2024-05-12T22:57:03.513182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-05-12T22:57:03.513073+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-05-12T22:57:03.513073+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.513073+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:11:11.698964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:20.077490+0000","last_change":"2024-05-12T22:57:20.077549+0000","last_active":"2024-05-12T22:57:20.077490+0000","last_peered":"2024-05-12T22:57:20.077490+0000","last_clean":"2024-05-12T22:57:20.077490+0000","last_became_active":"2024-05-12T22:52:35.591225+0000","last_became_peered":"2024-05-12T22:52:35.591225+0000","last_unstale":"2024-05-12T22:57:20.077490+0000","last_undegraded":"2024-05-12T22:57:20.077490+0000","last_fullsized":"2024-05-12T22:57:20.077490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:20.077313+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:20.077313+0000","last_clean_scrub_stamp":"2024-05-12T22:57:20.077313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:22:39.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:02.791259+0000","last_change":"2024-05-12T22:57:02.791259+0000","last_active":"2024-05-12T22:57:02.791259+0000","last_peered":"2024-05-12T22:57:02.791259+0000","last_clean":"2024-05-12T22:57:02.791259+0000","last_became_active":"2024-05-12T22:52:34.555517+0000","last_became_peered":"2024-05-12T22:52:34.555517+0000","last_unstale":"2024-05-12T22:57:02.791259+0000","last_undegraded":"2024-05-12T22:57:02.791259+0000","last_fullsized":"2024-05-12T22:57:02.791259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:02.791000+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:02.791000+0000","last_clean_scrub_stamp":"2024-05-12T22:57:02.791000+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:43:00.521658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:19.045411+0000","last_change":"2024-05-12T22:57:19.045471+0000","last_active":"2024-05-12T22:57:19.045411+0000","last_peered":"2024-05-12T22:57:19.045411+0000","last_clean":"2024-05-12T22:57:19.045411+0000","last_became_active":"2024-05-12T22:52:35.591504+0000","last_became_peered":"2024-05-12T22:52:35.591504+0000","last_unstale":"2024-05-12T22:57:19.045411+0000","last_undegraded":"2024-05-12T22:57:19.045411+0000","last_fullsized":"2024-05-12T22:57:19.045411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:19.045227+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:19.045227+0000","last_clean_scrub_stamp":"2024-05-12T22:57:19.045227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:35:10.000352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:01.526610+0000","last_change":"2024-05-12T22:57:01.526610+0000","last_active":"2024-05-12T22:57:01.526610+0000","last_peered":"2024-05-12T22:57:01.526610+0000","last_clean":"2024-05-12T22:57:01.526610+0000","last_became_active":"2024-05-12T22:52:34.549307+0000","last_became_peered":"2024-05-12T22:52:34.549307+0000","last_unstale":"2024-05-12T22:57:01.526610+0000","last_undegraded":"2024-05-12T22:57:01.526610+0000","last_fullsized":"2024-05-12T22:57:01.526610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:01.526446+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:01.526446+0000","last_clean_scrub_stamp":"2024-05-12T22:57:01.526446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:58:40.777884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'9","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:21.125692+0000","last_change":"2024-05-12T22:57:21.125814+0000","last_active":"2024-05-12T22:57:21.125692+0000","last_peered":"2024-05-12T22:57:21.125692+0000","last_clean":"2024-05-12T22:57:21.125692+0000","last_became_active":"2024-05-12T22:52:35.592302+0000","last_became_peered":"2024-05-12T22:52:35.592302+0000","last_unstale":"2024-05-12T22:57:21.125692+0000","last_undegraded":"2024-05-12T22:57:21.125692+0000","last_fullsized":"2024-05-12T22:57:21.125692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:21.125489+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:21.125489+0000","last_clean_scrub_stamp":"2024-05-12T22:57:21.125489+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T05:54:17.274483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:02.677139+0000","last_change":"2024-05-12T22:57:02.677139+0000","last_active":"2024-05-12T22:57:02.677139+0000","last_peered":"2024-05-12T22:57:02.677139+0000","last_clean":"2024-05-12T22:57:02.677139+0000","last_became_active":"2024-05-12T22:52:34.557601+0000","last_became_peered":"2024-05-12T22:52:34.557601+0000","last_unstale":"2024-05-12T22:57:02.677139+0000","last_undegraded":"2024-05-12T22:57:02.677139+0000","last_fullsized":"2024-05-12T22:57:02.677139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:02.676849+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:02.676849+0000","last_clean_scrub_stamp":"2024-05-12T22:57:02.676849+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:09:59.258882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.329230+0000","last_change":"2024-05-12T22:57:10.329347+0000","last_active":"2024-05-12T22:57:10.329230+0000","last_peered":"2024-05-12T22:57:10.329230+0000","last_clean":"2024-05-12T22:57:10.329230+0000","last_became_active":"2024-05-12T22:52:35.550451+0000","last_became_peered":"2024-05-12T22:52:35.550451+0000","last_unstale":"2024-05-12T22:57:10.329230+0000","last_undegraded":"2024-05-12T22:57:10.329230+0000","last_fullsized":"2024-05-12T22:57:10.329230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:10.328936+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:10.328936+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.328936+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:43:28.802857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:02.485163+0000","last_change":"2024-05-12T22:57:02.485163+0000","last_active":"2024-05-12T22:57:02.485163+0000","last_peered":"2024-05-12T22:57:02.485163+0000","last_clean":"2024-05-12T22:57:02.485163+0000","last_became_active":"2024-05-12T22:52:34.549345+0000","last_became_peered":"2024-05-12T22:52:34.549345+0000","last_unstale":"2024-05-12T22:57:02.485163+0000","last_undegraded":"2024-05-12T22:57:02.485163+0000","last_fullsized":"2024-05-12T22:57:02.485163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:02.485039+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:02.485039+0000","last_clean_scrub_stamp":"2024-05-12T22:57:02.485039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:04:02.239076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.103830+0000","last_change":"2024-05-12T22:57:05.103830+0000","last_active":"2024-05-12T22:57:05.103830+0000","last_peered":"2024-05-12T22:57:05.103830+0000","last_clean":"2024-05-12T22:57:05.103830+0000","last_became_active":"2024-05-12T22:52:35.572511+0000","last_became_peered":"2024-05-12T22:52:35.572511+0000","last_unstale":"2024-05-12T22:57:05.103830+0000","last_undegraded":"2024-05-12T22:57:05.103830+0000","last_fullsized":"2024-05-12T22:57:05.103830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:05.103579+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:05.103579+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.103579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:33:50.864720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":187,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.104312+0000","last_change":"2024-05-12T22:57:06.104381+0000","last_active":"2024-05-12T22:57:06.104312+0000","last_peered":"2024-05-12T22:57:06.104312+0000","last_clean":"2024-05-12T22:57:06.104312+0000","last_became_active":"2024-05-12T22:52:22.852134+0000","last_became_peered":"2024-05-12T22:52:22.852134+0000","last_unstale":"2024-05-12T22:57:06.104312+0000","last_undegraded":"2024-05-12T22:57:06.104312+0000","last_fullsized":"2024-05-12T22:57:06.104312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-05-12T22:57:06.104148+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-05-12T22:57:06.104148+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.104148+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:40:07.456550+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.287579+0000","last_change":"2024-05-12T22:57:04.287703+0000","last_active":"2024-05-12T22:57:04.287579+0000","last_peered":"2024-05-12T22:57:04.287579+0000","last_clean":"2024-05-12T22:57:04.287579+0000","last_became_active":"2024-05-12T22:52:34.548791+0000","last_became_peered":"2024-05-12T22:52:34.548791+0000","last_unstale":"2024-05-12T22:57:04.287579+0000","last_undegraded":"2024-05-12T22:57:04.287579+0000","last_fullsized":"2024-05-12T22:57:04.287579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:04.287363+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:04.287363+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.287363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:37:37.534045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.787121+0000","last_change":"2024-05-12T22:57:10.787180+0000","last_active":"2024-05-12T22:57:10.787121+0000","last_peered":"2024-05-12T22:57:10.787121+0000","last_clean":"2024-05-12T22:57:10.787121+0000","last_became_active":"2024-05-12T22:52:35.569255+0000","last_became_peered":"2024-05-12T22:52:35.569255+0000","last_unstale":"2024-05-12T22:57:10.787121+0000","last_undegraded":"2024-05-12T22:57:10.787121+0000","last_fullsized":"2024-05-12T22:57:10.787121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:10.786937+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:10.786937+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.786937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:37:08.844400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.075441+0000","last_change":"2024-05-12T22:57:09.075561+0000","last_active":"2024-05-12T22:57:09.075441+0000","last_peered":"2024-05-12T22:57:09.075441+0000","last_clean":"2024-05-12T22:57:09.075441+0000","last_became_active":"2024-05-12T22:52:34.575007+0000","last_became_peered":"2024-05-12T22:52:34.575007+0000","last_unstale":"2024-05-12T22:57:09.075441+0000","last_undegraded":"2024-05-12T22:57:09.075441+0000","last_fullsized":"2024-05-12T22:57:09.075441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:09.075240+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:09.075240+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.075240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:37:07.132703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.606011+0000","last_change":"2024-05-12T22:57:10.606076+0000","last_active":"2024-05-12T22:57:10.606011+0000","last_peered":"2024-05-12T22:57:10.606011+0000","last_clean":"2024-05-12T22:57:10.606011+0000","last_became_active":"2024-05-12T22:52:35.578569+0000","last_became_peered":"2024-05-12T22:52:35.578569+0000","last_unstale":"2024-05-12T22:57:10.606011+0000","last_undegraded":"2024-05-12T22:57:10.606011+0000","last_fullsized":"2024-05-12T22:57:10.606011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:10.605833+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:10.605833+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.605833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:18:55.130742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'20","reported_seq":63,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.480520+0000","last_change":"2024-05-12T22:57:04.480645+0000","last_active":"2024-05-12T22:57:04.480520+0000","last_peered":"2024-05-12T22:57:04.480520+0000","last_clean":"2024-05-12T22:57:04.480520+0000","last_became_active":"2024-05-12T22:52:34.550077+0000","last_became_peered":"2024-05-12T22:52:34.550077+0000","last_unstale":"2024-05-12T22:57:04.480520+0000","last_undegraded":"2024-05-12T22:57:04.480520+0000","last_fullsized":"2024-05-12T22:57:04.480520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-05-12T22:57:04.480305+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-05-12T22:57:04.480305+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.480305+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:39:50.895198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10908,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":14,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.562759+0000","last_change":"2024-05-12T22:57:10.562821+0000","last_active":"2024-05-12T22:57:10.562759+0000","last_peered":"2024-05-12T22:57:10.562759+0000","last_clean":"2024-05-12T22:57:10.562759+0000","last_became_active":"2024-05-12T22:52:35.549654+0000","last_became_peered":"2024-05-12T22:52:35.549654+0000","last_unstale":"2024-05-12T22:57:10.562759+0000","last_undegraded":"2024-05-12T22:57:10.562759+0000","last_fullsized":"2024-05-12T22:57:10.562759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:10.562577+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:10.562577+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.562577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:51:10.623342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:05.261141+0000","last_change":"2024-05-12T22:57:05.261206+0000","last_active":"2024-05-12T22:57:05.261141+0000","last_peered":"2024-05-12T22:57:05.261141+0000","last_clean":"2024-05-12T22:57:05.261141+0000","last_became_active":"2024-05-12T22:52:34.558831+0000","last_became_peered":"2024-05-12T22:52:34.558831+0000","last_unstale":"2024-05-12T22:57:05.261141+0000","last_undegraded":"2024-05-12T22:57:05.261141+0000","last_fullsized":"2024-05-12T22:57:05.261141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:05.260950+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:05.260950+0000","last_clean_scrub_stamp":"2024-05-12T22:57:05.260950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:33:51.022091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'9","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.793121+0000","last_change":"2024-05-12T22:57:07.793179+0000","last_active":"2024-05-12T22:57:07.793121+0000","last_peered":"2024-05-12T22:57:07.793121+0000","last_clean":"2024-05-12T22:57:07.793121+0000","last_became_active":"2024-05-12T22:52:35.593585+0000","last_became_peered":"2024-05-12T22:52:35.593585+0000","last_unstale":"2024-05-12T22:57:07.793121+0000","last_undegraded":"2024-05-12T22:57:07.793121+0000","last_fullsized":"2024-05-12T22:57:07.793121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:07.792948+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:07.792948+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.792948+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:57:24.176667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:01.626699+0000","last_change":"2024-05-12T22:57:01.626737+0000","last_active":"2024-05-12T22:57:01.626699+0000","last_peered":"2024-05-12T22:57:01.626699+0000","last_clean":"2024-05-12T22:57:01.626699+0000","last_became_active":"2024-05-12T22:52:34.554450+0000","last_became_peered":"2024-05-12T22:52:34.554450+0000","last_unstale":"2024-05-12T22:57:01.626699+0000","last_undegraded":"2024-05-12T22:57:01.626699+0000","last_fullsized":"2024-05-12T22:57:01.626699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:57:01.626582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:57:01.626582+0000","last_clean_scrub_stamp":"2024-05-12T22:57:01.626582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:50:21.683792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.319903+0000","last_change":"2024-05-12T22:57:09.319964+0000","last_active":"2024-05-12T22:57:09.319903+0000","last_peered":"2024-05-12T22:57:09.319903+0000","last_clean":"2024-05-12T22:57:09.319903+0000","last_became_active":"2024-05-12T22:52:35.549152+0000","last_became_peered":"2024-05-12T22:52:35.549152+0000","last_unstale":"2024-05-12T22:57:09.319903+0000","last_undegraded":"2024-05-12T22:57:09.319903+0000","last_fullsized":"2024-05-12T22:57:09.319903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:09.319728+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:09.319728+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.319728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T09:51:35.832432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:11.117343+0000","last_change":"2024-05-12T22:57:11.117409+0000","last_active":"2024-05-12T22:57:11.117343+0000","last_peered":"2024-05-12T22:57:11.117343+0000","last_clean":"2024-05-12T22:57:11.117343+0000","last_became_active":"2024-05-12T22:52:34.576249+0000","last_became_peered":"2024-05-12T22:52:34.576249+0000","last_unstale":"2024-05-12T22:57:11.117343+0000","last_undegraded":"2024-05-12T22:57:11.117343+0000","last_fullsized":"2024-05-12T22:57:11.117343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:11.117172+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:11.117172+0000","last_clean_scrub_stamp":"2024-05-12T22:57:11.117172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:40:00.280948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.545939+0000","last_change":"2024-05-12T22:57:08.546001+0000","last_active":"2024-05-12T22:57:08.545939+0000","last_peered":"2024-05-12T22:57:08.545939+0000","last_clean":"2024-05-12T22:57:08.545939+0000","last_became_active":"2024-05-12T22:52:35.549644+0000","last_became_peered":"2024-05-12T22:52:35.549644+0000","last_unstale":"2024-05-12T22:57:08.545939+0000","last_undegraded":"2024-05-12T22:57:08.545939+0000","last_fullsized":"2024-05-12T22:57:08.545939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-05-12T22:57:08.545764+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-05-12T22:57:08.545764+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.545764+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T00:29:17.090996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'42","reported_seq":71,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.569230+0000","last_change":"2024-05-12T22:57:06.569295+0000","last_active":"2024-05-12T22:57:06.569230+0000","last_peered":"2024-05-12T22:57:06.569230+0000","last_clean":"2024-05-12T22:57:06.569230+0000","last_became_active":"2024-05-12T22:52:34.570038+0000","last_became_peered":"2024-05-12T22:52:34.570038+0000","last_unstale":"2024-05-12T22:57:06.569230+0000","last_undegraded":"2024-05-12T22:57:06.569230+0000","last_fullsized":"2024-05-12T22:57:06.569230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'42","last_scrub_stamp":"2024-05-12T22:57:06.569064+0000","last_deep_scrub":"23'42","last_deep_scrub_stamp":"2024-05-12T22:57:06.569064+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.569064+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:58:18.118406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.734130+0000","last_change":"2024-05-12T22:57:12.734195+0000","last_active":"2024-05-12T22:57:12.734130+0000","last_peered":"2024-05-12T22:57:12.734130+0000","last_clean":"2024-05-12T22:57:12.734130+0000","last_became_active":"2024-05-12T22:52:35.573728+0000","last_became_peered":"2024-05-12T22:52:35.573728+0000","last_unstale":"2024-05-12T22:57:12.734130+0000","last_undegraded":"2024-05-12T22:57:12.734130+0000","last_fullsized":"2024-05-12T22:57:12.734130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:12.733939+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:12.733939+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.733939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:40:01.897716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.956074+0000","last_change":"2024-05-12T22:57:07.956142+0000","last_active":"2024-05-12T22:57:07.956074+0000","last_peered":"2024-05-12T22:57:07.956074+0000","last_clean":"2024-05-12T22:57:07.956074+0000","last_became_active":"2024-05-12T22:52:34.580425+0000","last_became_peered":"2024-05-12T22:52:34.580425+0000","last_unstale":"2024-05-12T22:57:07.956074+0000","last_undegraded":"2024-05-12T22:57:07.956074+0000","last_fullsized":"2024-05-12T22:57:07.956074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:07.955874+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:07.955874+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.955874+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:42:08.017092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:06.594657+0000","last_change":"2024-05-12T22:57:06.594717+0000","last_active":"2024-05-12T22:57:06.594657+0000","last_peered":"2024-05-12T22:57:06.594657+0000","last_clean":"2024-05-12T22:57:06.594657+0000","last_became_active":"2024-05-12T22:52:35.549748+0000","last_became_peered":"2024-05-12T22:52:35.549748+0000","last_unstale":"2024-05-12T22:57:06.594657+0000","last_undegraded":"2024-05-12T22:57:06.594657+0000","last_fullsized":"2024-05-12T22:57:06.594657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-05-12T22:57:06.594493+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-05-12T22:57:06.594493+0000","last_clean_scrub_stamp":"2024-05-12T22:57:06.594493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T02:29:05.303625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.104431+0000","last_change":"2024-05-12T22:57:07.104493+0000","last_active":"2024-05-12T22:57:07.104431+0000","last_peered":"2024-05-12T22:57:07.104431+0000","last_clean":"2024-05-12T22:57:07.104431+0000","last_became_active":"2024-05-12T22:52:34.563585+0000","last_became_peered":"2024-05-12T22:52:34.563585+0000","last_unstale":"2024-05-12T22:57:07.104431+0000","last_undegraded":"2024-05-12T22:57:07.104431+0000","last_fullsized":"2024-05-12T22:57:07.104431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-05-12T22:57:07.104252+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-05-12T22:57:07.104252+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.104252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:18:08.943474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.776841+0000","last_change":"2024-05-12T22:57:03.776905+0000","last_active":"2024-05-12T22:57:03.776841+0000","last_peered":"2024-05-12T22:57:03.776841+0000","last_clean":"2024-05-12T22:57:03.776841+0000","last_became_active":"2024-05-12T22:52:35.577340+0000","last_became_peered":"2024-05-12T22:52:35.577340+0000","last_unstale":"2024-05-12T22:57:03.776841+0000","last_undegraded":"2024-05-12T22:57:03.776841+0000","last_fullsized":"2024-05-12T22:57:03.776841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:03.776664+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:03.776664+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.776664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:13:32.015923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:04.598717+0000","last_change":"2024-05-12T22:57:04.598835+0000","last_active":"2024-05-12T22:57:04.598717+0000","last_peered":"2024-05-12T22:57:04.598717+0000","last_clean":"2024-05-12T22:57:04.598717+0000","last_became_active":"2024-05-12T22:52:34.563471+0000","last_became_peered":"2024-05-12T22:52:34.563471+0000","last_unstale":"2024-05-12T22:57:04.598717+0000","last_undegraded":"2024-05-12T22:57:04.598717+0000","last_fullsized":"2024-05-12T22:57:04.598717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:04.598509+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:04.598509+0000","last_clean_scrub_stamp":"2024-05-12T22:57:04.598509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:39:19.387383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'6","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.784981+0000","last_change":"2024-05-12T22:57:08.785041+0000","last_active":"2024-05-12T22:57:08.784981+0000","last_peered":"2024-05-12T22:57:08.784981+0000","last_clean":"2024-05-12T22:57:08.784981+0000","last_became_active":"2024-05-12T22:52:35.554426+0000","last_became_peered":"2024-05-12T22:52:35.554426+0000","last_unstale":"2024-05-12T22:57:08.784981+0000","last_undegraded":"2024-05-12T22:57:08.784981+0000","last_fullsized":"2024-05-12T22:57:08.784981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:08.784802+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:08.784802+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.784802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:18:10.624024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:03.643838+0000","last_change":"2024-05-12T22:57:03.643864+0000","last_active":"2024-05-12T22:57:03.643838+0000","last_peered":"2024-05-12T22:57:03.643838+0000","last_clean":"2024-05-12T22:57:03.643838+0000","last_became_active":"2024-05-12T22:52:34.558055+0000","last_became_peered":"2024-05-12T22:52:34.558055+0000","last_unstale":"2024-05-12T22:57:03.643838+0000","last_undegraded":"2024-05-12T22:57:03.643838+0000","last_fullsized":"2024-05-12T22:57:03.643838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-12T22:57:03.643722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-12T22:57:03.643722+0000","last_clean_scrub_stamp":"2024-05-12T22:57:03.643722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:29:16.099291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'9","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.796436+0000","last_change":"2024-05-12T22:57:07.796495+0000","last_active":"2024-05-12T22:57:07.796436+0000","last_peered":"2024-05-12T22:57:07.796436+0000","last_clean":"2024-05-12T22:57:07.796436+0000","last_became_active":"2024-05-12T22:52:35.553921+0000","last_became_peered":"2024-05-12T22:52:35.553921+0000","last_unstale":"2024-05-12T22:57:07.796436+0000","last_undegraded":"2024-05-12T22:57:07.796436+0000","last_fullsized":"2024-05-12T22:57:07.796436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:07.796260+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:07.796260+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.796260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T01:40:09.148661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'9","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.075778+0000","last_change":"2024-05-12T22:57:12.075849+0000","last_active":"2024-05-12T22:57:12.075778+0000","last_peered":"2024-05-12T22:57:12.075778+0000","last_clean":"2024-05-12T22:57:12.075778+0000","last_became_active":"2024-05-12T22:52:34.579526+0000","last_became_peered":"2024-05-12T22:52:34.579526+0000","last_unstale":"2024-05-12T22:57:12.075778+0000","last_undegraded":"2024-05-12T22:57:12.075778+0000","last_fullsized":"2024-05-12T22:57:12.075778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'9","last_scrub_stamp":"2024-05-12T22:57:12.075605+0000","last_deep_scrub":"23'9","last_deep_scrub_stamp":"2024-05-12T22:57:12.075605+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.075605+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:40:14.461188+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'7","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:12.914593+0000","last_change":"2024-05-12T22:57:12.914654+0000","last_active":"2024-05-12T22:57:12.914593+0000","last_peered":"2024-05-12T22:57:12.914593+0000","last_clean":"2024-05-12T22:57:12.914593+0000","last_became_active":"2024-05-12T22:52:35.579401+0000","last_became_peered":"2024-05-12T22:52:35.579401+0000","last_unstale":"2024-05-12T22:57:12.914593+0000","last_undegraded":"2024-05-12T22:57:12.914593+0000","last_fullsized":"2024-05-12T22:57:12.914593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:12.914409+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:12.914409+0000","last_clean_scrub_stamp":"2024-05-12T22:57:12.914409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-13T23:37:10.971871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'14","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:16.267352+0000","last_change":"2024-05-12T22:57:16.267413+0000","last_active":"2024-05-12T22:57:16.267352+0000","last_peered":"2024-05-12T22:57:16.267352+0000","last_clean":"2024-05-12T22:57:16.267352+0000","last_became_active":"2024-05-12T22:52:35.596936+0000","last_became_peered":"2024-05-12T22:52:35.596936+0000","last_unstale":"2024-05-12T22:57:16.267352+0000","last_undegraded":"2024-05-12T22:57:16.267352+0000","last_fullsized":"2024-05-12T22:57:16.267352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-05-12T22:57:16.267183+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-05-12T22:57:16.267183+0000","last_clean_scrub_stamp":"2024-05-12T22:57:16.267183+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T10:15:04.356734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'6","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:10.106566+0000","last_change":"2024-05-12T22:57:10.106632+0000","last_active":"2024-05-12T22:57:10.106566+0000","last_peered":"2024-05-12T22:57:10.106566+0000","last_clean":"2024-05-12T22:57:10.106566+0000","last_became_active":"2024-05-12T22:52:34.575257+0000","last_became_peered":"2024-05-12T22:52:34.575257+0000","last_unstale":"2024-05-12T22:57:10.106566+0000","last_undegraded":"2024-05-12T22:57:10.106566+0000","last_fullsized":"2024-05-12T22:57:10.106566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:10.106393+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:10.106393+0000","last_clean_scrub_stamp":"2024-05-12T22:57:10.106393+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:02:59.324758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.502806+0000","last_change":"2024-05-12T22:57:07.502868+0000","last_active":"2024-05-12T22:57:07.502806+0000","last_peered":"2024-05-12T22:57:07.502806+0000","last_clean":"2024-05-12T22:57:07.502806+0000","last_became_active":"2024-05-12T22:53:16.699663+0000","last_became_peered":"2024-05-12T22:53:16.699663+0000","last_unstale":"2024-05-12T22:57:07.502806+0000","last_undegraded":"2024-05-12T22:57:07.502806+0000","last_fullsized":"2024-05-12T22:57:07.502806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:07.502625+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:07.502625+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.502625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T07:29:19.958194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'7","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:08.061956+0000","last_change":"2024-05-12T22:57:08.062081+0000","last_active":"2024-05-12T22:57:08.061956+0000","last_peered":"2024-05-12T22:57:08.061956+0000","last_clean":"2024-05-12T22:57:08.061956+0000","last_became_active":"2024-05-12T22:52:34.575355+0000","last_became_peered":"2024-05-12T22:52:34.575355+0000","last_unstale":"2024-05-12T22:57:08.061956+0000","last_undegraded":"2024-05-12T22:57:08.061956+0000","last_fullsized":"2024-05-12T22:57:08.061956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:08.061615+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:08.061615+0000","last_clean_scrub_stamp":"2024-05-12T22:57:08.061615+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T04:51:08.388440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'8","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:07.580647+0000","last_change":"2024-05-12T22:57:07.580708+0000","last_active":"2024-05-12T22:57:07.580647+0000","last_peered":"2024-05-12T22:57:07.580647+0000","last_clean":"2024-05-12T22:57:07.580647+0000","last_became_active":"2024-05-12T22:52:35.558384+0000","last_became_peered":"2024-05-12T22:52:35.558384+0000","last_unstale":"2024-05-12T22:57:07.580647+0000","last_undegraded":"2024-05-12T22:57:07.580647+0000","last_fullsized":"2024-05-12T22:57:07.580647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2024-05-12T22:57:07.580451+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2024-05-12T22:57:07.580451+0000","last_clean_scrub_stamp":"2024-05-12T22:57:07.580451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T08:34:22.130568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:02.684258+0000","last_change":"2024-05-12T22:57:02.684279+0000","last_active":"2024-05-12T22:57:02.684258+0000","last_peered":"2024-05-12T22:57:02.684258+0000","last_clean":"2024-05-12T22:57:02.684258+0000","last_became_active":"2024-05-12T22:52:34.550780+0000","last_became_peered":"2024-05-12T22:52:34.550780+0000","last_unstale":"2024-05-12T22:57:02.684258+0000","last_undegraded":"2024-05-12T22:57:02.684258+0000","last_fullsized":"2024-05-12T22:57:02.684258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-05-12T22:57:02.684198+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-05-12T22:57:02.684198+0000","last_clean_scrub_stamp":"2024-05-12T22:57:02.684198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:57:19.067917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:09.823630+0000","last_change":"2024-05-12T22:57:09.823687+0000","last_active":"2024-05-12T22:57:09.823630+0000","last_peered":"2024-05-12T22:57:09.823630+0000","last_clean":"2024-05-12T22:57:09.823630+0000","last_became_active":"2024-05-12T22:52:35.556273+0000","last_became_peered":"2024-05-12T22:52:35.556273+0000","last_unstale":"2024-05-12T22:57:09.823630+0000","last_undegraded":"2024-05-12T22:57:09.823630+0000","last_fullsized":"2024-05-12T22:57:09.823630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-05-12T22:57:09.823456+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-05-12T22:57:09.823456+0000","last_clean_scrub_stamp":"2024-05-12T22:57:09.823456+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T03:11:38.480899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-12T22:57:02.474441+0000","last_change":"2024-05-12T22:57:02.474509+0000","last_active":"2024-05-12T22:57:02.474441+0000","last_peered":"2024-05-12T22:57:02.474441+0000","last_clean":"2024-05-12T22:57:02.474441+0000","last_became_active":"2024-05-12T22:52:34.576503+0000","last_became_peered":"2024-05-12T22:52:34.576503+0000","last_unstale":"2024-05-12T22:57:02.474441+0000","last_undegraded":"2024-05-12T22:57:02.474441+0000","last_fullsized":"2024-05-12T22:57:02.474441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-05-12T22:57:02.474269+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-05-12T22:57:02.474269+0000","last_clean_scrub_stamp":"2024-05-12T22:57:02.474269+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-14T06:53:19.582445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":507,"ondisk_log_size":507,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":799303,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":21,"num_write":179,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":1598606,"data_compressed":229594,"data_compressed_allocated":278528,"data_compressed_original":1400832,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67022,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":675733,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":872380,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":84873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":84909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542207,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":883288,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542208,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":95691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":84943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":675789,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33511,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":798505,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":787597,"data_compressed":114797,"data_compressed_allocated":139264,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-12T22:57:24.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-12T22:57:24.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 Processor -- start 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 -- start start 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c0afd30 con 0x7f7c4c0b51a0 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c0b1050 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c546d6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c06cb20 con 0x7f7c4c06c740 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c51c71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c51c71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52014/0 (socket says 172.21.15.40:52014) 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c51c71640 1 -- 172.21.15.40:0/1006241793 learned_addr learned my addr 172.21.15.40:0/1006241793 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c52472640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.676+0000 7f7c51470640 1 -- 172.21.15.40:0/1006241793 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411539430 0 0) 0x7f7c4c0afd30 con 0x7f7c4c0b51a0 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.680+0000 7f7c51470640 1 -- 172.21.15.40:0/1006241793 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c38003510 con 0x7f7c4c0b51a0 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51c71640 1 -- 172.21.15.40:0/1006241793 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 msgr2=0x7f7c4c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:24.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51c71640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51c71640 1 -- 172.21.15.40:0/1006241793 >> v1:172.21.15.47:6789/0 conn(0x7f7c4c0b51a0 legacy=0x7f7c4c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51c71640 1 -- 172.21.15.40:0/1006241793 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0b24a0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51c71640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c006fd0 tx=0x7f7c3c025410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d823f8aae38b82 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51470640 1 -- 172.21.15.40:0/1006241793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004030 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51470640 1 -- 172.21.15.40:0/1006241793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0041d0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c51470640 1 -- 172.21.15.40:0/1006241793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c003620 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 -- 172.21.15.40:0/1006241793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 msgr2=0x7f7c4c0b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c006fd0 tx=0x7f7c3c025410 comp rx=0 tx=0).stop 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 -- 172.21.15.40:0/1006241793 shutdown_connections 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c0b3610 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 --2- 172.21.15.40:0/1006241793 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 -- 172.21.15.40:0/1006241793 >> 172.21.15.40:0/1006241793 conn(0x7f7c4c0b8de0 msgr2=0x7f7c4c0b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 -- 172.21.15.40:0/1006241793 shutdown_connections 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.684+0000 7f7c546d6640 1 -- 172.21.15.40:0/1006241793 wait complete. 2024-05-12T22:57:24.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 Processor -- start 2024-05-12T22:57:24.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 -- start start 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c0b51a0 0x7f7c4c1ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b14e0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b4260 con 0x7f7c4c0b51a0 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c546d6640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c08b200 con 0x7f7c4c06c740 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52020/0 (socket says 172.21.15.40:52020) 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 -- 172.21.15.40:0/4067794425 learned_addr learned my addr 172.21.15.40:0/4067794425 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c52472640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c52c73640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c0b51a0 0x7f7c4c1ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 -- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 msgr2=0x7f7c4c0a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0a95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 -- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c0b51a0 msgr2=0x7f7c4c1ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c0b51a0 0x7f7c4c1ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 -- 172.21.15.40:0/4067794425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0aa6e0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.688+0000 7f7c51c71640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c000c10 tx=0x7f7c3c0221b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0c5070 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0c1640 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c0aa9c0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004030 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c15e5d0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c08b380 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c3c0c8070 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 0x7f7c30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:24.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7c3c129350 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c52472640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 0x7f7c30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:24.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.692+0000 7f7c52472640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 0x7f7c30069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009d20 tx=0x7f7c48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:24.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.696+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7c3c01f000 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.860+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7c4c15e030 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.864+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f7c3c0f9ea0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.864+0000 7f7c42ffd640 1 -- 172.21.15.40:0/4067794425 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7c3c0041d0 con 0x7f7c4c0b4d40 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 msgr2=0x7f7c30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 0x7f7c30069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009d20 tx=0x7f7c48008040 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 msgr2=0x7f7c4c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c000c10 tx=0x7f7c3c0221b0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 shutdown_connections 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7c300678f0 0x7f7c30069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c0b51a0 0x7f7c4c1ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0b4d40 0x7f7c4c15a500 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 --2- 172.21.15.40:0/4067794425 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c4c06c740 0x7f7c4c0a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 >> 172.21.15.40:0/4067794425 conn(0x7f7c4c0b8de0 msgr2=0x7f7c4c0b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 shutdown_connections 2024-05-12T22:57:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:24.868+0000 7f7c546d6640 1 -- 172.21.15.40:0/4067794425 wait complete. 2024-05-12T22:57:24.886 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-12T22:57:24.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:57:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.004+0000 7fa690d01640 1 Processor -- start 2024-05-12T22:57:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa690d01640 1 -- start start 2024-05-12T22:57:25.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa690d01640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa68c13f760 0x7fa68c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa690d01640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c0b6150 con 0x7fa68c0b5d70 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa690d01640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c06f620 con 0x7fa68c149070 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa690d01640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c06f990 con 0x7fa68c13f760 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa68c0b5d70 0x7fa68c148960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60472/0 (socket says 172.21.15.40:60472) 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68a59c640 1 -- 172.21.15.40:0/1035456905 learned_addr learned my addr 172.21.15.40:0/1035456905 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549366648 0 0) 0x7fa68c0b6150 con 0x7fa68c0b5d70 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68ad9d640 1 --2- 172.21.15.40:0/1035456905 >> v2:172.21.15.47:3300/0 conn(0x7fa68c13f760 0x7fa68c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa678003530 con 0x7fa68c0b5d70 2024-05-12T22:57:25.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763386597 0 0) 0x7fa678003530 con 0x7fa68c0b5d70 2024-05-12T22:57:25.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 >> v2:172.21.15.47:3300/0 conn(0x7fa68c13f760 msgr2=0x7fa68c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:25.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 --2- 172.21.15.40:0/1035456905 >> v2:172.21.15.47:3300/0 conn(0x7fa68c13f760 0x7fa68c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 >> v1:172.21.15.47:6789/0 conn(0x7fa68c149070 legacy=0x7fa68c13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0b4ea0 con 0x7fa68c0b5d70 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7fa67c001680 con 0x7fa68c0b5d70 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 >> v1:172.21.15.40:6789/0 conn(0x7fa68c0b5d70 legacy=0x7fa68c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6780039c0 0x7fa678003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa678004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6780052f0 0x7fa67800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800c190 con 0x7fa678004810 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800c340 con 0x7fa6780052f0 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa67800c540 con 0x7fa6780039c0 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa678004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68ad9d640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6780052f0 0x7fa67800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 -- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6780039c0 msgr2=0x7fa678003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6780039c0 0x7fa678003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 -- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6780052f0 msgr2=0x7fa67800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:25.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6780052f0 0x7fa67800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa689d9b640 1 -- 172.21.15.40:0/1035456905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa678003530 con 0x7fa678004810 2024-05-12T22:57:25.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68ad9d640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6780052f0 0x7fa67800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:25.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.008+0000 7fa68ad9d640 1 -- 172.21.15.40:0/1035456905 reap_dead start 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa678004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa674001750 tx=0x7fa67401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183615312c7acf4c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740013a0 con 0x7fa678004810 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa6740052f0 con 0x7fa678004810 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68959a640 1 -- 172.21.15.40:0/1035456905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674003860 con 0x7fa678004810 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 msgr2=0x7fa678004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa678004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa674001750 tx=0x7fa67401c3c0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- 172.21.15.40:0/1035456905 shutdown_connections 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 --2- 172.21.15.40:0/1035456905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa678004c90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- 172.21.15.40:0/1035456905 >> 172.21.15.40:0/1035456905 conn(0x7fa68c06b6c0 msgr2=0x7fa68c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- 172.21.15.40:0/1035456905 shutdown_connections 2024-05-12T22:57:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- 172.21.15.40:0/1035456905 wait complete. 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 Processor -- start 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- start start 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa68c1d1070 0x7fa68c1425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 0x7fa68c13c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c148cd0 con 0x7fa678004810 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c148b50 con 0x7fa68c13bd80 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa690d01640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c148e50 con 0x7fa68c1d1070 2024-05-12T22:57:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52030/0 (socket says 172.21.15.40:52030) 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 -- 172.21.15.40:0/1167308347 learned_addr learned my addr 172.21.15.40:0/1167308347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa68c1d1070 0x7fa68c1425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68ad9d640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 0x7fa68c13c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 -- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa68c1d1070 msgr2=0x7fa68c1425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa68c1d1070 0x7fa68c1425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 -- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 msgr2=0x7fa68c13c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 0x7fa68c13c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 -- 172.21.15.40:0/1167308347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c1430f0 con 0x7fa678004810 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68ad9d640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 0x7fa68c13c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa68a59c640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c700 tx=0x7fa67c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.012+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c018070 con 0x7fa678004810 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa67c0072f0 con 0x7fa678004810 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c1433d0 con 0x7fa678004810 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0047f0 con 0x7fa678004810 2024-05-12T22:57:25.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c143de0 con 0x7fa678004810 2024-05-12T22:57:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c068330 con 0x7fa678004810 2024-05-12T22:57:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa67c01b070 con 0x7fa678004810 2024-05-12T22:57:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa682ffd640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 0x7fa66c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa67c085350 con 0x7fa678004810 2024-05-12T22:57:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 0x7fa66c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.016+0000 7fa689d9b640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 0x7fa66c069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa678004790 tx=0x7fa6740011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.020+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa67c055ce0 con 0x7fa678004810 2024-05-12T22:57:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.212+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa68c0b6c60 con 0x7fa678004810 2024-05-12T22:57:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa682ffd640 1 -- 172.21.15.40:0/1167308347 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7fa67c0555e0 con 0x7fa678004810 2024-05-12T22:57:25.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:57:25.218 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:57:25.218 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:57:25.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 msgr2=0x7fa66c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 0x7fa66c069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa678004790 tx=0x7fa6740011a0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 msgr2=0x7fa68c1d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c700 tx=0x7fa67c00cbc0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 shutdown_connections 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa66c0678f0 0x7fa66c069db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa68c13bd80 0x7fa68c13c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa68c1d1070 0x7fa68c1425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 --2- 172.21.15.40:0/1167308347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa678004810 0x7fa68c1d1700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 >> 172.21.15.40:0/1167308347 conn(0x7fa68c06b6c0 msgr2=0x7fa68c144440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 shutdown_connections 2024-05-12T22:57:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.216+0000 7fa690d01640 1 -- 172.21.15.40:0/1167308347 wait complete. 2024-05-12T22:57:25.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-12T22:57:25.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 Processor -- start 2024-05-12T22:57:25.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 -- start start 2024-05-12T22:57:25.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2bc0bd800 0x7fa2bc1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2bc148040 con 0x7fa2bc141720 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa2bc0bdbe0 con 0x7fa2bc0bd800 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.344+0000 7fa2c27e9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa2bc0b6f40 con 0x7fa2bc147be0 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2bc0bd800 0x7fa2bc1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bb7fe640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c0d86640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa2bc141720 0x7fa2bc0b7810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.40:38084/0 (socket says 172.21.15.40:38084) 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c0d86640 1 -- 172.21.15.40:0/3660885130 learned_addr learned my addr 172.21.15.40:0/3660885130 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:25.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 -- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 msgr2=0x7fa2bc1411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:25.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 --2- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc1411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 -- 172.21.15.40:0/3660885130 >> v1:172.21.15.47:6789/0 conn(0x7fa2bc141720 legacy=0x7fa2bc0b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 -- 172.21.15.40:0/3660885130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc0b56e0 con 0x7fa2bc0bd800 2024-05-12T22:57:25.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2bbfff640 1 --2- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc1476a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00097c0 tx=0x7fa2b001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90df15d388a9e9c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2baffd640 1 -- 172.21.15.40:0/3660885130 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b0070 con 0x7fa2bc0bd800 2024-05-12T22:57:25.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2baffd640 1 -- 172.21.15.40:0/3660885130 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa2b00ab600 con 0x7fa2bc0bd800 2024-05-12T22:57:25.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2baffd640 1 -- 172.21.15.40:0/3660885130 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00ab9f0 con 0x7fa2bc0bd800 2024-05-12T22:57:25.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 -- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc0bd800 msgr2=0x7fa2bc1476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc1476a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00097c0 tx=0x7fa2b001c380 comp rx=0 tx=0).stop 2024-05-12T22:57:25.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 -- 172.21.15.40:0/3660885130 shutdown_connections 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/3660885130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc1476a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.348+0000 7fa2c27e9640 1 -- 172.21.15.40:0/3660885130 >> 172.21.15.40:0/3660885130 conn(0x7fa2bc072ff0 msgr2=0x7fa2bc0bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- 172.21.15.40:0/3660885130 shutdown_connections 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- 172.21.15.40:0/3660885130 wait complete. 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 Processor -- start 2024-05-12T22:57:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- start start 2024-05-12T22:57:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc141720 0x7fa2bc13c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc0b9690 con 0x7fa2bc0bd800 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc0b9510 con 0x7fa2bc141720 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fa2bc0b44e0 con 0x7fa2bc147be0 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52040/0 (socket says 172.21.15.40:52040) 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 -- 172.21.15.40:0/2325662411 learned_addr learned my addr 172.21.15.40:0/2325662411 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c0d86640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bb7fe640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc141720 0x7fa2bc13c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 -- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 msgr2=0x7fa2bc13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 -- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc141720 msgr2=0x7fa2bc13c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc141720 0x7fa2bc13c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 -- 172.21.15.40:0/2325662411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc1e00c0 con 0x7fa2bc0bd800 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c0d86640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2bbfff640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ae040 tx=0x7fa2b0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b8020 con 0x7fa2bc0bd800 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc1e0340 con 0x7fa2bc0bd800 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa2b00b4410 con 0x7fa2bc0bd800 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b0040 con 0x7fa2bc0bd800 2024-05-12T22:57:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.352+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc13ef20 con 0x7fa2bc0bd800 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc068330 con 0x7fa2bc0bd800 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2b00bb020 con 0x7fa2bc0bd800 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2b8ff9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 0x7fa2a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa2b011f980 con 0x7fa2bc0bd800 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2bb7fe640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 0x7fa2a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.356+0000 7fa2bb7fe640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 0x7fa2a8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc13be50 tx=0x7fa2ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.360+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa2b00c2030 con 0x7fa2bc0bd800 2024-05-12T22:57:25.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.556+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2bc0b6150 con 0x7fa2bc0bd800 2024-05-12T22:57:25.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2b8ff9640 1 -- 172.21.15.40:0/2325662411 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3527 (secure 0 0 0) 0x7fa2bc1e00c0 con 0x7fa2bc0bd800 2024-05-12T22:57:25.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:57:25.562 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/4136712795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":4136712795},{"type":"v1","addr":"172.21.15.47:6833","nonce":4136712795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-12T22:52:34.894154+0000","modified":"2024-05-12T22:52:36.884030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3972544441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3972544441},{"type":"v1","addr":"172.21.15.40:6835","nonce":3972544441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-12T22:57:25.563 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-05-12T22:57:25.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 msgr2=0x7fa2a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 0x7fa2a8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc13be50 tx=0x7fa2ac008040 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 msgr2=0x7fa2bc0b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ae040 tx=0x7fa2b0019120 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 shutdown_connections 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2bc147be0 0x7fa2bc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fa2a80678c0 0x7fa2a8069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc141720 0x7fa2bc13c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 --2- 172.21.15.40:0/2325662411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2bc0bd800 0x7fa2bc0b2bb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 >> 172.21.15.40:0/2325662411 conn(0x7fa2bc072ff0 msgr2=0x7fa2bc145630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 shutdown_connections 2024-05-12T22:57:25.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.560+0000 7fa2c27e9640 1 -- 172.21.15.40:0/2325662411 wait complete. 2024-05-12T22:57:25.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-12T22:57:25.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 Processor -- start 2024-05-12T22:57:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 -- start start 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f0c071fe0 0x7f7f0c072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0c0b26b0 con 0x7f7f0c0b18d0 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0c0738a0 con 0x7f7f0c0b22d0 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f11748640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0c073410 con 0x7f7f0c071fe0 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f0c071fe0 0x7f7f0c072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0a7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7f0c0b18d0 0x7f7f0c1439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60482/0 (socket says 172.21.15.40:60482) 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0a7fc640 1 -- 172.21.15.40:0/1980518750 learned_addr learned my addr 172.21.15.40:0/1980518750 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0b7fe640 1 -- 172.21.15.40:0/1980518750 >> v1:172.21.15.47:6789/0 conn(0x7f7f0c0b22d0 legacy=0x7f7f0c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0b7fe640 1 -- 172.21.15.40:0/1980518750 >> v1:172.21.15.40:6789/0 conn(0x7f7f0c0b18d0 legacy=0x7f7f0c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f09ffb640 1 -- 172.21.15.40:0/1980518750 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086584535 0 0) 0x7f7f0c0b26b0 con 0x7f7f0c0b18d0 2024-05-12T22:57:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0b7fe640 1 -- 172.21.15.40:0/1980518750 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c0730a0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f0b7fe640 1 --2- 172.21.15.40:0/1980518750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c072490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009d90 tx=0x7f7f0401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4ae27e498fa78c server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.704+0000 7f7f09ffb640 1 -- 172.21.15.40:0/1980518750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f040a66a0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f09ffb640 1 -- 172.21.15.40:0/1980518750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f040a6840 con 0x7f7f0c071fe0 2024-05-12T22:57:25.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f09ffb640 1 -- 172.21.15.40:0/1980518750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f040a6c30 con 0x7f7f0c071fe0 2024-05-12T22:57:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/1980518750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 msgr2=0x7f7f0c072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 --2- 172.21.15.40:0/1980518750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c072490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009d90 tx=0x7f7f0401c850 comp rx=0 tx=0).stop 2024-05-12T22:57:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/1980518750 shutdown_connections 2024-05-12T22:57:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 --2- 172.21.15.40:0/1980518750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c072490 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/1980518750 >> 172.21.15.40:0/1980518750 conn(0x7f7f0c0b62d0 msgr2=0x7f7f0c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/1980518750 shutdown_connections 2024-05-12T22:57:25.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/1980518750 wait complete. 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 Processor -- start 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- start start 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f0c0b18d0 0x7f7f0c0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c0b22d0 0x7f7f0c0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c152740 con 0x7f7f0c071fe0 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1525c0 con 0x7f7f0c0b22d0 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0c1528c0 con 0x7f7f0c0b18d0 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0a7fc640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f0c0b18d0 0x7f7f0c0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c0b22d0 0x7f7f0c0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52056/0 (socket says 172.21.15.40:52056) 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 -- 172.21.15.40:0/3545498178 learned_addr learned my addr 172.21.15.40:0/3545498178 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 -- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f0c0b18d0 msgr2=0x7f7f0c0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f0c0b18d0 0x7f7f0c0ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 -- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c0b22d0 msgr2=0x7f7f0c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c0b22d0 0x7f7f0c0ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 -- 172.21.15.40:0/3545498178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1e1a70 con 0x7f7f0c071fe0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f0affd640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c500 tx=0x7f7efc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc016020 con 0x7f7f0c071fe0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7efc005220 con 0x7f7f0c071fe0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc007030 con 0x7f7f0c071fe0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c0adf90 con 0x7f7f0c071fe0 2024-05-12T22:57:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.708+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1e1010 con 0x7f7f0c071fe0 2024-05-12T22:57:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c068a40 con 0x7f7f0c071fe0 2024-05-12T22:57:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7efc0071d0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7ef37fe640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 0x7f7ef8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:25.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7efc0855d0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7f0a7fc640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 0x7f7ef8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:25.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.712+0000 7f7f0a7fc640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 0x7f7ef8069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f00007bc0 tx=0x7f7f00007b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.716+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7efc020020 con 0x7f7f0c071fe0 2024-05-12T22:57:25.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.880+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f0c0adcb0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.880+0000 7f7ef37fe640 1 -- 172.21.15.40:0/3545498178 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16783 (secure 0 0 0) 0x7f7efc0074c0 con 0x7f7f0c071fe0 2024-05-12T22:57:25.884 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-05-12T22:57:25.884 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"b0a63ee2-381a-4a33-b1a1-0e740f041feb","created":"2024-05-12T22:52:10.652835+0000","modified":"2024-05-12T22:53:16.686879+0000","last_up_change":"2024-05-12T22:52:21.468428+0000","last_in_change":"2024-05-12T22:52:12.981253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-12T22:52:21.426108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-12T22:52:33.297648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-12T22:52:33.880238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59ceb6a6-8ca7-43bf-bdbd-54b273059bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6809","nonce":415151301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6811","nonce":415151301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6815","nonce":415151301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":415151301},{"type":"v1","addr":"172.21.15.40:6813","nonce":415151301}]},"public_addr":"172.21.15.40:6809/415151301","cluster_addr":"172.21.15.40:6811/415151301","heartbeat_back_addr":"172.21.15.40:6815/415151301","heartbeat_front_addr":"172.21.15.40:6813/415151301","state":["exists","up"]},{"osd":1,"uuid":"e67e2478-c6dd-443c-86cf-64aa1af50a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6817","nonce":4284490578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6819","nonce":4284490578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6823","nonce":4284490578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4284490578},{"type":"v1","addr":"172.21.15.40:6821","nonce":4284490578}]},"public_addr":"172.21.15.40:6817/4284490578","cluster_addr":"172.21.15.40:6819/4284490578","heartbeat_back_addr":"172.21.15.40:6823/4284490578","heartbeat_front_addr":"172.21.15.40:6821/4284490578","state":["exists","up"]},{"osd":2,"uuid":"9c3f5029-4b6c-4553-ba53-622cd0d90cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6801","nonce":931675717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6803","nonce":931675717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6807","nonce":931675717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":931675717},{"type":"v1","addr":"172.21.15.40:6805","nonce":931675717}]},"public_addr":"172.21.15.40:6801/931675717","cluster_addr":"172.21.15.40:6803/931675717","heartbeat_back_addr":"172.21.15.40:6807/931675717","heartbeat_front_addr":"172.21.15.40:6805/931675717","state":["exists","up"]},{"osd":3,"uuid":"9bd43011-db63-465f-8acb-8116fe529703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6825","nonce":2549687319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6827","nonce":2549687319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6831","nonce":2549687319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2549687319},{"type":"v1","addr":"172.21.15.40:6829","nonce":2549687319}]},"public_addr":"172.21.15.40:6825/2549687319","cluster_addr":"172.21.15.40:6827/2549687319","heartbeat_back_addr":"172.21.15.40:6831/2549687319","heartbeat_front_addr":"172.21.15.40:6829/2549687319","state":["exists","up"]},{"osd":4,"uuid":"46fb748d-c27a-4be5-a6f8-8d3543445f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6811","nonce":1602313510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6814","nonce":1602313510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6820","nonce":1602313510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1602313510},{"type":"v1","addr":"172.21.15.47:6817","nonce":1602313510}]},"public_addr":"172.21.15.47:6811/1602313510","cluster_addr":"172.21.15.47:6814/1602313510","heartbeat_back_addr":"172.21.15.47:6820/1602313510","heartbeat_front_addr":"172.21.15.47:6817/1602313510","state":["exists","up"]},{"osd":5,"uuid":"b517cfd6-acf2-4ad9-9c41-78aa9294a4d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6810","nonce":941811801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6816","nonce":941811801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6823","nonce":941811801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6819","nonce":941811801},{"type":"v1","addr":"172.21.15.47:6821","nonce":941811801}]},"public_addr":"172.21.15.47:6810/941811801","cluster_addr":"172.21.15.47:6816/941811801","heartbeat_back_addr":"172.21.15.47:6823/941811801","heartbeat_front_addr":"172.21.15.47:6821/941811801","state":["exists","up"]},{"osd":6,"uuid":"8738813f-2581-4b6c-8c42-42cad388606c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6801","nonce":2478742162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6803","nonce":2478742162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6807","nonce":2478742162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2478742162},{"type":"v1","addr":"172.21.15.47:6805","nonce":2478742162}]},"public_addr":"172.21.15.47:6801/2478742162","cluster_addr":"172.21.15.47:6803/2478742162","heartbeat_back_addr":"172.21.15.47:6807/2478742162","heartbeat_front_addr":"172.21.15.47:6805/2478742162","state":["exists","up"]},{"osd":7,"uuid":"a5bf4fd0-87f4-4a32-8773-d0da1ffbbea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6825","nonce":2871462616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6827","nonce":2871462616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6831","nonce":2871462616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2871462616},{"type":"v1","addr":"172.21.15.47:6829","nonce":2871462616}]},"public_addr":"172.21.15.47:6825/2871462616","cluster_addr":"172.21.15.47:6827/2871462616","heartbeat_back_addr":"172.21.15.47:6831/2871462616","heartbeat_front_addr":"172.21.15.47:6829/2871462616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.172856+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.263077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.247836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.610979+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.483479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.568604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.377081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-12T22:52:18.503175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-12T22:57:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 msgr2=0x7f7ef8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 0x7f7ef8069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f00007bc0 tx=0x7f7f00007b10 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 msgr2=0x7f7f0c1e1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c500 tx=0x7f7efc00c9c0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 shutdown_connections 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f7ef80678c0 0x7f7ef8069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c0b22d0 0x7f7f0c0ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f0c0b18d0 0x7f7f0c0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 --2- 172.21.15.40:0/3545498178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0c071fe0 0x7f7f0c1e1530 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 >> 172.21.15.40:0/3545498178 conn(0x7f7f0c0b62d0 msgr2=0x7f7f0c06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 shutdown_connections 2024-05-12T22:57:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:25.884+0000 7f7f11748640 1 -- 172.21.15.40:0/3545498178 wait complete. 2024-05-12T22:57:25.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 Processor -- start 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 -- start start 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1b7c0b5d70 0x7f1b7c148960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c0b2c50 0x7f1b7c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b7c13f050 0x7f1b7c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c06f990 con 0x7f1b7c13f050 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0708b0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b80ed9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c13fa20 con 0x7f1b7c0b2c50 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b7c13f050 0x7f1b7c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b7c13f050 0x7f1b7c13f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52058/0 (socket says 172.21.15.40:52058) 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 -- 172.21.15.40:0/3772081987 learned_addr learned my addr 172.21.15.40:0/3772081987 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7a59c640 1 --2- 172.21.15.40:0/3772081987 >> v2:172.21.15.47:3300/0 conn(0x7f1b7c0b5d70 0x7f1b7c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b79d9b640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c0b2c50 0x7f1b7c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 -- 172.21.15.40:0/3772081987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c0b2c50 msgr2=0x7f1b7c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c0b2c50 0x7f1b7c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 -- 172.21.15.40:0/3772081987 >> v2:172.21.15.47:3300/0 conn(0x7f1b7c0b5d70 msgr2=0x7f1b7c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 --2- 172.21.15.40:0/3772081987 >> v2:172.21.15.47:3300/0 conn(0x7f1b7c0b5d70 0x7f1b7c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.024+0000 7f1b7ad9d640 1 -- 172.21.15.40:0/3772081987 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0b6150 con 0x7f1b7c13f050 2024-05-12T22:57:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7ad9d640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c13f050 0x7f1b7c13f4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06df50 tx=0x7f1b7401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c8bb610e2548a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7959a640 1 -- 172.21.15.40:0/3772081987 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740a5800 con 0x7f1b7c13f050 2024-05-12T22:57:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7959a640 1 -- 172.21.15.40:0/3772081987 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1b740a59a0 con 0x7f1b7c13f050 2024-05-12T22:57:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7959a640 1 -- 172.21.15.40:0/3772081987 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740a5d90 con 0x7f1b7c13f050 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- 172.21.15.40:0/3772081987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c13f050 msgr2=0x7f1b7c13f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c13f050 0x7f1b7c13f4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06df50 tx=0x7f1b7401c960 comp rx=0 tx=0).stop 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- 172.21.15.40:0/3772081987 shutdown_connections 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c13f050 0x7f1b7c13f4e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/3772081987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c0b2c50 0x7f1b7c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/3772081987 >> v2:172.21.15.47:3300/0 conn(0x7f1b7c0b5d70 0x7f1b7c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- 172.21.15.40:0/3772081987 >> 172.21.15.40:0/3772081987 conn(0x7f1b7c06b6c0 msgr2=0x7f1b7c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- 172.21.15.40:0/3772081987 shutdown_connections 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- 172.21.15.40:0/3772081987 wait complete. 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 Processor -- start 2024-05-12T22:57:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- start start 2024-05-12T22:57:26.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c0b2c50 0x7f1b7c137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 0x7f1b7c1e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0b3fa0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0b3e20 con 0x7f1b7c0b2c50 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b80ed9640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0b4120 con 0x7f1b7c13f050 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52072/0 (socket says 172.21.15.40:52072) 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 -- 172.21.15.40:0/2337264428 learned_addr learned my addr 172.21.15.40:0/2337264428 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7a59c640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c0b2c50 0x7f1b7c137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7ad9d640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 0x7f1b7c1e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 -- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 msgr2=0x7f1b7c1e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 0x7f1b7c1e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 -- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c0b2c50 msgr2=0x7f1b7c137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c0b2c50 0x7f1b7c137450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 -- 172.21.15.40:0/2337264428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0b9170 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b7ad9d640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 0x7f1b7c1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.028+0000 7f1b79d9b640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e930 tx=0x7f1b7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70017070 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1b7000ca00 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c0b1240 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000cdd0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c0b79e0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c068330 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b7001a070 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1b70086160 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b7a59c640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.032+0000 7f1b7a59c640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 0x7f1b5c069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009a70 tx=0x7f1b6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.036+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1b70056ce0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.228+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1b7c1483d0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b6affd640 1 -- 172.21.15.40:0/2337264428 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f1b700565e0 con 0x7f1b7c0b5d70 2024-05-12T22:57:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-12T22:57:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 msgr2=0x7f1b5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 0x7f1b5c069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009a70 tx=0x7f1b6c008040 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 msgr2=0x7f1b7c0b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e930 tx=0x7f1b7000edf0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 shutdown_connections 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b7c13f050 0x7f1b7c1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b7c0b5d70 0x7f1b7c0b8940 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e930 tx=0x7f1b7000edf0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f1b5c0678c0 0x7f1b5c069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 --2- 172.21.15.40:0/2337264428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c0b2c50 0x7f1b7c137450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 >> 172.21.15.40:0/2337264428 conn(0x7f1b7c06b6c0 msgr2=0x7f1b7c145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 shutdown_connections 2024-05-12T22:57:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.232+0000 7f1b80ed9640 1 -- 172.21.15.40:0/2337264428 wait complete. 2024-05-12T22:57:26.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-12T22:57:26.318 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-05-12T22:57:26.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 Processor -- start 2024-05-12T22:57:26.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 -- start start 2024-05-12T22:57:26.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f69fc0bd800 0x7f69fc14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69fc1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69fc14b5b0 con 0x7f69fc141720 2024-05-12T22:57:26.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f69fc0b5c80 con 0x7f69fc0bd800 2024-05-12T22:57:26.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f6a01577640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc0bdbe0 con 0x7f69fc14b130 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69fb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f69fc141720 0x7f69fc0b7810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60490/0 (socket says 172.21.15.40:60490) 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69fb7fe640 1 -- 172.21.15.40:0/2937205052 learned_addr learned my addr 172.21.15.40:0/2937205052 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 --2- 172.21.15.40:0/2937205052 >> v2:172.21.15.47:3300/0 conn(0x7f69fc0bd800 0x7f69fc14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69fc1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906644281 0 0) 0x7f69ec001120 con 0x7f69fc141720 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e4003530 con 0x7f69fc141720 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872631235 0 0) 0x7f69e4003530 con 0x7f69fc141720 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 msgr2=0x7f69fc1411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69fc1411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 >> v2:172.21.15.47:3300/0 conn(0x7f69fc0bd800 msgr2=0x7f69fc14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 --2- 172.21.15.40:0/2937205052 >> v2:172.21.15.47:3300/0 conn(0x7f69fc0bd800 0x7f69fc14abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc0b6f20 con 0x7f69fc141720 2024-05-12T22:57:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2962468538 0 0) 0x7f69ec001850 con 0x7f69fc141720 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 >> v1:172.21.15.40:6789/0 conn(0x7f69fc141720 legacy=0x7f69fc0b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e4004d50 0x7f69e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc0b5c80 con 0x7f69e40039c0 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc0bdbe0 con 0x7f69e4004d50 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f69e400b9d0 con 0x7f69fc14b130 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 -- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 msgr2=0x7f69e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc14b130 0x7f69e4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 -- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e4004d50 msgr2=0x7f69e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e4004d50 0x7f69e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.364+0000 7f69faffd640 1 -- 172.21.15.40:0/2937205052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e4003530 con 0x7f69e40039c0 2024-05-12T22:57:26.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f69faffd640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69e4003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fc0 tx=0x7f69f401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccda8f570ebda08 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40b2070 con 0x7f69e40039c0 2024-05-12T22:57:26.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f69f40a5ab0 con 0x7f69e40039c0 2024-05-12T22:57:26.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f69f9ffb640 1 -- 172.21.15.40:0/2937205052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4009c10 con 0x7f69e40039c0 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- 172.21.15.40:0/2937205052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 msgr2=0x7f69e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 --2- 172.21.15.40:0/2937205052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69e4003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fc0 tx=0x7f69f401ccc0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f69fb7fe640 1 -- 172.21.15.40:0/2937205052 reap_dead start 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- 172.21.15.40:0/2937205052 shutdown_connections 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- 172.21.15.40:0/2937205052 >> 172.21.15.40:0/2937205052 conn(0x7f69fc072ff0 msgr2=0x7f69fc0bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- 172.21.15.40:0/2937205052 shutdown_connections 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- 172.21.15.40:0/2937205052 wait complete. 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 Processor -- start 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- start start 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 0x7f69fc1e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc143310 0x7f69fc1e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc0b44c0 con 0x7f69e40039c0 2024-05-12T22:57:26.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc141b00 con 0x7f69fc142eb0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.368+0000 7f6a01577640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc0b4640 con 0x7f69fc143310 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52108/0 (socket says 172.21.15.40:52108) 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 -- 172.21.15.40:0/2487062404 learned_addr learned my addr 172.21.15.40:0/2487062404 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 0x7f69fc1e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 -- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc143310 msgr2=0x7f69fc1e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc143310 0x7f69fc1e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 -- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 msgr2=0x7f69fc1e0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 0x7f69fc1e0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 -- 172.21.15.40:0/2487062404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc1d6c30 con 0x7f69e40039c0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 0x7f69fc1e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69faffd640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69f40985d0 tx=0x7f69f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40ba070 con 0x7f69e40039c0 2024-05-12T22:57:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f69f40ada20 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc144d10 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40b2040 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc144370 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69fc068a40 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69f40b6410 con 0x7f69e40039c0 2024-05-12T22:57:26.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 0x7f69e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:26.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 0x7f69e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:26.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f69f41204f0 con 0x7f69e40039c0 2024-05-12T22:57:26.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.372+0000 7f69fa7fc640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 0x7f69e8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69fc140560 tx=0x7f69f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:26.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.376+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f69f40169d0 con 0x7f69e40039c0 2024-05-12T22:57:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:26.580+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f69fc14af10 con 0x7f69e40039c0 2024-05-12T22:57:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.232+0000 7f69e37fe640 1 -- 172.21.15.40:0/2487062404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f69f40f0880 con 0x7f69e40039c0 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 msgr2=0x7f69e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 0x7f69e8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69fc140560 tx=0x7f69f0008040 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 msgr2=0x7f69fc142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69f40985d0 tx=0x7f69f4009750 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 shutdown_connections 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f69fc143310 0x7f69fc1e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7f69e80678c0 0x7f69e8069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc142eb0 0x7f69fc1e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 --2- 172.21.15.40:0/2487062404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e40039c0 0x7f69fc142050 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 >> 172.21.15.40:0/2487062404 conn(0x7f69fc072ff0 msgr2=0x7f69fc146560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 shutdown_connections 2024-05-12T22:57:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.236+0000 7f6a01577640 1 -- 172.21.15.40:0/2487062404 wait complete. 2024-05-12T22:57:27.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-12T22:57:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.384+0000 7feecd410640 1 Processor -- start 2024-05-12T22:57:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.384+0000 7feecd410640 1 -- start start 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feec80b4910 0x7feec814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec8151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec814b700 con 0x7feec80bd770 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7feec80bdb50 con 0x7feec80b4910 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7feec80b9530 con 0x7feec814b270 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feec80b4910 0x7feec814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feec80b4910 0x7feec814ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52120/0 (socket says 172.21.15.40:52120) 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 -- 172.21.15.40:0/1374577747 learned_addr learned my addr 172.21.15.40:0/1374577747 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec77fe640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec8151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 -- 172.21.15.40:0/1374577747 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 msgr2=0x7feec8151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec8151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 -- 172.21.15.40:0/1374577747 >> v1:172.21.15.47:6789/0 conn(0x7feec80bd770 legacy=0x7feec8141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 -- 172.21.15.40:0/1374577747 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80b5420 con 0x7feec80b4910 2024-05-12T22:57:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec77fe640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec8151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec67fc640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec814ad30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009860 tx=0x7feeb001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362e1608be99b47a server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec5ffb640 1 -- 172.21.15.40:0/1374577747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00ab600 con 0x7feec80b4910 2024-05-12T22:57:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec5ffb640 1 -- 172.21.15.40:0/1374577747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feeb00b0070 con 0x7feec80b4910 2024-05-12T22:57:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feec5ffb640 1 -- 172.21.15.40:0/1374577747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00ab9e0 con 0x7feec80b4910 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- 172.21.15.40:0/1374577747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 msgr2=0x7feec814ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec814ad30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009860 tx=0x7feeb001c440 comp rx=0 tx=0).stop 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- 172.21.15.40:0/1374577747 shutdown_connections 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec8151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 --2- 172.21.15.40:0/1374577747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec814ad30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- 172.21.15.40:0/1374577747 >> 172.21.15.40:0/1374577747 conn(0x7feec8072ff0 msgr2=0x7feec80bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- 172.21.15.40:0/1374577747 shutdown_connections 2024-05-12T22:57:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.388+0000 7feecd410640 1 -- 172.21.15.40:0/1374577747 wait complete. 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 Processor -- start 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- start start 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feec80bd770 0x7feec8144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec81e3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feec8141ba0 con 0x7feec80b4910 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feec8141a20 con 0x7feec80bd770 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7feec80b4e50 con 0x7feec814b270 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52124/0 (socket says 172.21.15.40:52124) 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 -- 172.21.15.40:0/2394059038 learned_addr learned my addr 172.21.15.40:0/2394059038 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec77fe640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec81e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 -- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 msgr2=0x7feec81e3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec81e3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec67fc640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feec80bd770 0x7feec8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 -- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feec80bd770 msgr2=0x7feec8144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feec80bd770 0x7feec8144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 -- 172.21.15.40:0/2394059038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec8142eb0 con 0x7feec80b4910 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feec6ffd640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c7c0 tx=0x7feeb800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8016020 con 0x7feec80b4910 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feeb800aa50 con 0x7feec80b4910 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec814d220 con 0x7feec80b4910 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8012420 con 0x7feec80b4910 2024-05-12T22:57:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec814cf40 con 0x7feec80b4910 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec8068330 con 0x7feec80b4910 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.392+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feeb8019020 con 0x7feec80b4910 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.396+0000 7feebf7fe640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 0x7feea8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.396+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7feeb8085e00 con 0x7feec80b4910 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.396+0000 7feec67fc640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 0x7feea8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.396+0000 7feec67fc640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 0x7feea8069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.400+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7feeb8020030 con 0x7feec80b4910 2024-05-12T22:57:27.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:27.556+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feec8149200 con 0x7feec80b4910 2024-05-12T22:57:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.236+0000 7feebf7fe640 1 -- 172.21.15.40:0/2394059038 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7feeb8056870 con 0x7feec80b4910 2024-05-12T22:57:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-05-12T22:57:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 msgr2=0x7feea8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 0x7feea8069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb0008040 comp rx=0 tx=0).stop 2024-05-12T22:57:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 msgr2=0x7feec81479f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c7c0 tx=0x7feeb800cc80 comp rx=0 tx=0).stop 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 shutdown_connections 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feec814b270 0x7feec81e3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7feea80678c0 0x7feea8069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feec80bd770 0x7feec8144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 --2- 172.21.15.40:0/2394059038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feec80b4910 0x7feec81479f0 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c7c0 tx=0x7feeb800cc80 comp rx=0 tx=0).stop 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 >> 172.21.15.40:0/2394059038 conn(0x7feec8072ff0 msgr2=0x7feec8149a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 shutdown_connections 2024-05-12T22:57:28.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.240+0000 7feecd410640 1 -- 172.21.15.40:0/2394059038 wait complete. 2024-05-12T22:57:28.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-12T22:57:28.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 Processor -- start 2024-05-12T22:57:28.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 -- start start 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0640bd770 0x7fc064141310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0640b4910 0x7fc064141850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 0x7fc06414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc06414b700 con 0x7fc0640b4910 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc0640bdb50 con 0x7fc06414ad30 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc06b483640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc0640b9530 con 0x7fc0640bd770 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc068a1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0640b4910 0x7fc064141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc068a1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0640b4910 0x7fc064141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52128/0 (socket says 172.21.15.40:52128) 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.392+0000 7fc068a1e640 1 -- 172.21.15.40:0/905554593 learned_addr learned my addr 172.21.15.40:0/905554593 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc069a20640 1 --2- 172.21.15.40:0/905554593 >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 0x7fc06414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc06921f640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0640bd770 0x7fc064141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 -- 172.21.15.40:0/905554593 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0640bd770 msgr2=0x7fc064141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0640bd770 0x7fc064141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 -- 172.21.15.40:0/905554593 >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 msgr2=0x7fc06414b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 --2- 172.21.15.40:0/905554593 >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 0x7fc06414b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 -- 172.21.15.40:0/905554593 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0640b5420 con 0x7fc0640b4910 2024-05-12T22:57:28.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc069a20640 1 --2- 172.21.15.40:0/905554593 >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 0x7fc06414b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:28.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc068a1e640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640b4910 0x7fc064141850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bde30 tx=0x7fc05401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf78eb3a3956850 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:28.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc05bfff640 1 -- 172.21.15.40:0/905554593 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0540ab620 con 0x7fc0640b4910 2024-05-12T22:57:28.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc05bfff640 1 -- 172.21.15.40:0/905554593 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc0540b0070 con 0x7fc0640b4910 2024-05-12T22:57:28.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.396+0000 7fc05bfff640 1 -- 172.21.15.40:0/905554593 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0540aba00 con 0x7fc0640b4910 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/905554593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640b4910 msgr2=0x7fc064141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640b4910 0x7fc064141850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bde30 tx=0x7fc05401c460 comp rx=0 tx=0).stop 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/905554593 shutdown_connections 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- 172.21.15.40:0/905554593 >> v2:172.21.15.47:3300/0 conn(0x7fc06414ad30 0x7fc06414b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640b4910 0x7fc064141850 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- 172.21.15.40:0/905554593 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0640bd770 0x7fc064141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/905554593 >> 172.21.15.40:0/905554593 conn(0x7fc064072ff0 msgr2=0x7fc0640bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/905554593 shutdown_connections 2024-05-12T22:57:28.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/905554593 wait complete. 2024-05-12T22:57:28.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 Processor -- start 2024-05-12T22:57:28.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- start start 2024-05-12T22:57:28.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0640b4910 0x7fc064148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 0x7fc0640bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0640b4fd0 con 0x7fc0640bd770 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0640b4e50 con 0x7fc0640b4910 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 -- 0x7fc0640b7f90 con 0x7fc06414ad30 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52144/0 (socket says 172.21.15.40:52144) 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 -- 172.21.15.40:0/544068979 learned_addr learned my addr 172.21.15.40:0/544068979 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06921f640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0640b4910 0x7fc064148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc069a20640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 0x7fc0640bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 -- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 msgr2=0x7fc0640bc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 0x7fc0640bc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 -- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0640b4910 msgr2=0x7fc064148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0640b4910 0x7fc064148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 -- 172.21.15.40:0/544068979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0640bc7f0 con 0x7fc0640bd770 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc069a20640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 0x7fc0640bc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-12T22:57:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc068a1e640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc05401c290 tx=0x7fc054019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054005ba0 con 0x7fc0640bd770 2024-05-12T22:57:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc054005d80 con 0x7fc0640bd770 2024-05-12T22:57:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc064144400 con 0x7fc0640bd770 2024-05-12T22:57:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054003a90 con 0x7fc0640bd770 2024-05-12T22:57:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0641499f0 con 0x7fc0640bd770 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.400+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc064068330 con 0x7fc0640bd770 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.404+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc054003c30 con 0x7fc0640bd770 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.404+0000 7fc059ffb640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 0x7fc048069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.404+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7fc054120540 con 0x7fc0640bd770 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.404+0000 7fc06921f640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 0x7fc048069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-12T22:57:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.404+0000 7fc06921f640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 0x7fc048069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bbd80 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-12T22:57:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.408+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc0540b9070 con 0x7fc0640bd770 2024-05-12T22:57:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:28.568+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc064139a00 con 0x7fc0640bd770 2024-05-12T22:57:29.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.264+0000 7fc059ffb640 1 -- 172.21.15.40:0/544068979 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fc054016110 con 0x7fc0640bd770 2024-05-12T22:57:29.267 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-05-12T22:57:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 msgr2=0x7fc048069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 0x7fc048069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bbd80 tx=0x7fc060008040 comp rx=0 tx=0).stop 2024-05-12T22:57:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 msgr2=0x7fc0641e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-12T22:57:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc05401c290 tx=0x7fc054019200 comp rx=0 tx=0).stop 2024-05-12T22:57:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 shutdown_connections 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc06414ad30 0x7fc0640bc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0640bd770 0x7fc0641e2dc0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc05401c290 tx=0x7fc054019200 comp rx=0 tx=0).stop 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.40:6832/1199194677,v1:172.21.15.40:6833/1199194677] conn(0x7fc0480678c0 0x7fc048069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 --2- 172.21.15.40:0/544068979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0640b4910 0x7fc064148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.268+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 >> 172.21.15.40:0/544068979 conn(0x7fc064072ff0 msgr2=0x7fc0641410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.272+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 shutdown_connections 2024-05-12T22:57:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-05-12T22:57:29.272+0000 7fc06b483640 1 -- 172.21.15.40:0/544068979 wait complete. 2024-05-12T22:57:29.299 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-12T22:57:29.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-12T22:57:29.300 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:29.309 INFO:tasks.ceph.mds.a:Stopped 2024-05-12T22:57:29.310 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-12T22:57:29.310 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:29.325 INFO:tasks.ceph.mds.b:Stopped 2024-05-12T22:57:29.325 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-12T22:57:29.326 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-12T22:57:29.326 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:31.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-12T22:57:32.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:32.611 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:35.427 INFO:tasks.ceph.osd.0:Stopped 2024-05-12T22:57:35.428 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-12T22:57:35.428 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.511 INFO:tasks.ceph.osd.1:Stopped 2024-05-12T22:57:35.511 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-12T22:57:35.511 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.612 INFO:tasks.ceph.osd.2:Stopped 2024-05-12T22:57:35.612 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-12T22:57:35.612 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.683 INFO:tasks.ceph.osd.3:Stopped 2024-05-12T22:57:35.684 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-12T22:57:35.684 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.764 INFO:tasks.ceph.osd.4:Stopped 2024-05-12T22:57:35.764 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-12T22:57:35.764 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.860 INFO:tasks.ceph.osd.5:Stopped 2024-05-12T22:57:35.860 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-12T22:57:35.860 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:35.933 INFO:tasks.ceph.osd.6:Stopped 2024-05-12T22:57:35.934 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-12T22:57:35.934 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.019 INFO:tasks.ceph.osd.7:Stopped 2024-05-12T22:57:36.019 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-12T22:57:36.019 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-12T22:57:36.019 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.050 INFO:tasks.ceph.mgr.y:Stopped 2024-05-12T22:57:36.050 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-12T22:57:36.050 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.078 INFO:tasks.ceph.mgr.x:Stopped 2024-05-12T22:57:36.078 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-12T22:57:36.078 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-12T22:57:36.078 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.108 INFO:tasks.ceph.mon.a:Stopped 2024-05-12T22:57:36.109 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-12T22:57:36.109 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.131 INFO:tasks.ceph.mon.b:Stopped 2024-05-12T22:57:36.132 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-12T22:57:36.132 INFO:teuthology.orchestra.run:waiting for 300 2024-05-12T22:57:36.195 INFO:tasks.ceph.mon.c:Stopped 2024-05-12T22:57:36.195 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-12T22:57:36.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-12T22:57:36.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-12T22:57:36.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-12T22:57:36.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-12T22:57:36.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-12T22:57:36.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:57:36.236 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-12T22:57:36.609 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:57:36.609 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-12T22:57:36.846 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:57:36.847 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-12T22:57:37.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:57:37.012 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-12T22:57:37.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:57:37.223 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-12T22:57:37.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:57:37.468 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-12T22:57:37.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:57:37.643 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-12T22:57:37.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:57:37.927 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-12T22:57:38.085 INFO:tasks.ceph:Archiving mon data... 2024-05-12T22:57:38.087 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/data/mon.a.tgz 2024-05-12T22:57:38.087 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-05-12T22:57:38.104 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.nk1l2WHXYM 2024-05-12T22:57:38.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nk1l2WHXYM 2024-05-12T22:57:38.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.nk1l2WHXYM 2024-05-12T22:57:38.365 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.nk1l2WHXYM is 288KB 2024-05-12T22:57:38.427 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.nk1l2WHXYM 2024-05-12T22:57:38.433 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/data/mon.b.tgz 2024-05-12T22:57:38.433 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-12T22:57:38.438 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.WlbkB9Icw6 2024-05-12T22:57:38.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WlbkB9Icw6 2024-05-12T22:57:38.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.WlbkB9Icw6 2024-05-12T22:57:38.640 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.WlbkB9Icw6 is 390KB 2024-05-12T22:57:38.658 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.WlbkB9Icw6 2024-05-12T22:57:38.663 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/data/mon.c.tgz 2024-05-12T22:57:38.663 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-12T22:57:38.711 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.kgeEs9Vtts 2024-05-12T22:57:38.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kgeEs9Vtts 2024-05-12T22:57:38.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.kgeEs9Vtts 2024-05-12T22:57:38.910 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.kgeEs9Vtts is 391KB 2024-05-12T22:57:38.973 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.kgeEs9Vtts 2024-05-12T22:57:38.977 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-12T22:57:38.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-12T22:57:38.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-12T22:57:39.057 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-12T22:57:39.075 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-12T22:57:39.075 INFO:tasks.ceph:Archiving crash dumps... 2024-05-12T22:57:39.077 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi040/crash 2024-05-12T22:57:39.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-12T22:57:39.116 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi047/crash 2024-05-12T22:57:39.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-12T22:57:39.129 INFO:tasks.ceph:Shutting down logrotate 2024-05-12T22:57:39.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:39.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:39.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:39.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-12T22:57:39.275 INFO:tasks.ceph:Compressing logs... 2024-05-12T22:57:39.276 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T22:57:39.278 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-12T22:57:39.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-05-12T22:57:39.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31632.log 2024-05-12T22:57:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-05-12T22:57:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31489.log 2024-05-12T22:57:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-12T22:57:39.310 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32462.log: /var/log/ceph/ceph-client.admin.31489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31922.log 2024-05-12T22:57:39.310 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-05-12T22:57:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.31922.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35237.log 2024-05-12T22:57:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35731.log 2024-05-12T22:57:39.311 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-05-12T22:57:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32051.log 2024-05-12T22:57:39.312 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35237.log.gz 2024-05-12T22:57:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-12T22:57:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35731.log: /var/log/ceph/ceph-client.admin.32051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32988.log 2024-05-12T22:57:39.313 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35731.log.gz 2024-05-12T22:57:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31337.log 2024-05-12T22:57:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-05-12T22:57:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27496.log 2024-05-12T22:57:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35783.log 2024-05-12T22:57:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35551.log: /var/log/ceph/ceph-client.admin.27496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32469.log 2024-05-12T22:57:39.314 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-05-12T22:57:39.316 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31818.log 2024-05-12T22:57:39.316 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-05-12T22:57:39.316 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35341.log 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35783.log.gz 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32988.log.gz 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35185.log 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32248.log 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35341.log.gz 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35185.log: /var/log/ceph/ceph-client.admin.32248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31632.log.gz 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27605.log 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35185.log.gz 2024-05-12T22:57:39.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-05-12T22:57:39.320 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.27605.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35367.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.34960.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35367.log: /var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35367.log.gz 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35705.log/var/log/ceph/ceph-mon.a.log: 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35629.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34855.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35705.log.gz 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31463.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35629.log: /var/log/ceph/ceph-client.admin.34855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-05-12T22:57:39.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35629.log.gz 2024-05-12T22:57:39.322 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34855.log.gz 2024-05-12T22:57:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32000.log 2024-05-12T22:57:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.33014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-05-12T22:57:39.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32262.log 2024-05-12T22:57:39.332 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32051.log.gz 2024-05-12T22:57:39.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-05-12T22:57:39.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32262.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32248.log.gzgzip 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31597.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.33095.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32000.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32262.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32469.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34907.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35471.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.34907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32728.log 2024-05-12T22:57:39.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34907.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35471.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32258.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32261.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32728.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32258.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.27496.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35107.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35107.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35107.log.gz 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31792.log 2024-05-12T22:57:39.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31896.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34881.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31896.log: /var/log/ceph/ceph-client.admin.34881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34881.log.gz 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32054.log: /var/log/ceph/ceph-client.admin.35445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31408.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32650.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32258.log.gz 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27721.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32650.log: /var/log/ceph/ceph-client.admin.35499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35263.log 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.27721.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2024-05-12T22:57:39.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35577.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35263.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32261.log.gzgzip 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35263.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32053.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31714.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35577.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32047.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31818.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35419.log 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31792.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31896.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31922.log.gz 2024-05-12T22:57:39.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33224.log 2024-05-12T22:57:39.357 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.33224.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35419.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35038.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32780.log: /var/log/ceph/ceph-client.admin.35038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32858.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35038.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31435.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31844.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32466.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-05-12T22:57:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32466.log: /var/log/ceph/ceph-client.admin.32884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35679.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35679.log: /var/log/ceph/ceph-client.admin.34986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32260.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32053.log.gz 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35679.log.gz 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35133.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31240.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31240.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35133.log.gz 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-12T22:57:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35828.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32047.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35828.log: 88.7% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32244.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35828.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.a.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32466.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31658.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31382.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34803.log 2024-05-12T22:57:39.360 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27605.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.34803.log: /var/log/ceph/ceph-client.admin.33040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34803.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35211.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31569.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.27721.log.gz -5 --verbose 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph.tmp-client.admin.22733.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32050.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.tmp-client.admin.22733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32052.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22733.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35211.log.gz 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35393.log 2024-05-12T22:57:39.361 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34829.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31948.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%/var/log/ceph/ceph-client.admin.34829.log: -- replaced with /var/log/ceph/ceph-client.admin.32260.log.gz 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35393.log.gz 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34829.log.gz 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32806.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31974.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31684.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35159.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32832.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35603.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35159.log: /var/log/ceph/ceph-client.admin.32832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-05-12T22:57:39.362 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35159.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35315.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35854.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35603.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35315.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32754.log: /var/log/ceph/ceph-client.admin.34934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32470.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32244.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32468.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32702.log/var/log/ceph/ceph-client.admin.35081.log: 2024-05-12T22:57:39.363 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31766.log 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31658.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.31766.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32052.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32050.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31948.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31684.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31974.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32470.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32702.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-05-12T22:57:39.364 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31766.log.gz 2024-05-12T22:57:39.366 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-05-12T22:57:39.366 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-12T22:57:39.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27679.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-12T22:57:39.366 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27727.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27655.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27727.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27631.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27727.log.gz 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9%/var/log/ceph/ceph-mon.c.log: -- replaced with /var/log/ceph/ceph-client.admin.27655.log.gz 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27559.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27631.log.gz 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-12T22:57:39.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27559.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6%/var/log/ceph/ceph-mds.b.log: -- replaced with /var/log/ceph/ceph-client.admin.27559.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.b.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27703.log 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.4.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27583.log 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27607.log 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27583.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27703.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27583.log.gz 2024-05-12T22:57:39.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27607.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27607.log.gz 2024-05-12T22:57:39.373 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32650.log.gz 2024-05-12T22:57:39.382 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-05-12T22:57:39.382 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2024-05-12T22:57:39.382 INFO:teuthology.orchestra.run.smithi040.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-05-12T22:57:39.391 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31489.log.gz 2024-05-12T22:57:39.391 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-05-12T22:57:39.392 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2024-05-12T22:57:39.392 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-05-12T22:57:39.392 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31597.log.gz 2024-05-12T22:57:39.406 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31240.log.gz 2024-05-12T22:57:39.406 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-05-12T22:57:39.407 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32806.log.gz 2024-05-12T22:57:39.407 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32832.log.gz 2024-05-12T22:57:39.407 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32858.log.gz 2024-05-12T22:57:39.407 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31337.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31382.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31435.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31408.log.gz 2024-05-12T22:57:39.424 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31463.log.gz 2024-05-12T22:57:39.428 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.33224.log.gz 2024-05-12T22:57:39.434 INFO:teuthology.orchestra.run.smithi047.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-12T22:57:39.480 INFO:teuthology.orchestra.run.smithi040.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-12T22:57:39.481 INFO:teuthology.orchestra.run.smithi047.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-12T22:57:40.009 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-12T22:57:40.070 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-12T22:57:40.078 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-12T22:57:40.090 INFO:teuthology.orchestra.run.smithi047.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-12T22:57:40.120 INFO:teuthology.orchestra.run.smithi047.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-12T22:57:40.121 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-05-12T22:57:40.121 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m0.796s 2024-05-12T22:57:40.121 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m3.088s 2024-05-12T22:57:40.121 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.120s 2024-05-12T22:57:40.907 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-12T22:57:41.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-12T22:57:41.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-12T22:57:41.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-12T22:57:46.876 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-12T22:57:46.932 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-12T22:57:47.195 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-12T22:57:47.209 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-12T22:57:47.210 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-05-12T22:57:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m7.930s 2024-05-12T22:57:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m7.427s 2024-05-12T22:57:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.343s 2024-05-12T22:57:47.211 INFO:tasks.ceph:Archiving logs... 2024-05-12T22:57:47.211 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi040/log 2024-05-12T22:57:47.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T22:57:47.781 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi047/log 2024-05-12T22:57:47.782 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-12T22:57:48.161 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-12T22:57:48.171 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-12T22:57:48.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T22:57:48.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-12T22:57:48.254 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-12T22:57:48.263 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-12T22:57:48.264 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T22:57:48.266 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-12T22:57:48.281 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T22:57:48.281 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-05-12T22:57:48.281 INFO:teuthology.orchestra.run.smithi047.stdout:+hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.072 -3.752 1.459 2024-05-12T22:57:48.282 INFO:teuthology.orchestra.run.smithi047.stdout:+hv02.front.sepi 63.231.80.2 3 u 2 64 377 0.092 -1.831 1.376 2024-05-12T22:57:48.282 INFO:teuthology.orchestra.run.smithi047.stdout:*hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.072 -0.288 1.454 2024-05-12T22:57:48.282 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-12T22:57:48.331 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-05-12T22:57:48.332 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-05-12T22:57:48.332 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 67.205.162.81 3 u 59 64 377 0.080 -2.746 0.585 2024-05-12T22:57:48.332 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.086 -0.774 0.367 2024-05-12T22:57:48.332 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.087 -1.153 0.481 2024-05-12T22:57:48.332 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-12T22:57:48.333 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-12T22:57:48.364 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-12T22:57:48.365 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-12T22:57:48.376 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-12T22:57:48.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-12T22:57:48.446 INFO:teuthology.task.internal:Duration was 1031.794669 seconds 2024-05-12T22:57:48.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-12T22:57:48.470 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-12T22:57:48.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T22:57:48.475 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-12T22:57:48.667 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-12T22:57:48.667 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-05-12T22:57:48.667 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T22:57:48.696 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-05-12T22:57:48.696 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-12T22:57:48.708 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-12T22:57:48.708 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T22:57:48.739 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-12T22:57:48.809 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-12T22:57:48.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T22:57:48.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-12T22:57:49.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-12T22:57:49.186 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-12T22:57:49.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T22:57:49.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-12T22:57:49.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-12T22:57:49.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T22:57:49.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-12T22:57:49.282 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-05-12T22:57:49.290 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-05-12T22:57:49.310 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T22:57:49.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:57:49.362 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-12T22:57:49.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-12T22:57:49.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-12T22:57:49.378 INFO:teuthology.task.internal:Transferring archived files... 2024-05-12T22:57:49.379 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi040 2024-05-12T22:57:49.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T22:57:49.425 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-12_21:24:02-fs-squid-distro-default-smithi/7703995/remote/smithi047 2024-05-12T22:57:49.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-12T22:57:49.447 INFO:teuthology.task.internal:Removing archive directory... 2024-05-12T22:57:49.447 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T22:57:49.462 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-12T22:57:49.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-12T22:57:49.502 INFO:teuthology.task.internal:Not uploading archives. 2024-05-12T22:57:49.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-12T22:57:49.513 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-12T22:57:49.513 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T22:57:49.516 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-12T22:57:49.519 INFO:teuthology.orchestra.run.smithi040.stdout: 658751 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 22:57 /home/ubuntu/cephtest 2024-05-12T22:57:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: 658839 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 12 22:57 /home/ubuntu/cephtest 2024-05-12T22:57:49.541 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-12T22:57:49.552 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-12T22:57:49.580 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} duration: 1031.794668674469 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-05-12T22:57:49.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-12T22:57:49.653 INFO:teuthology.run:pass